Log Import DTS Task Becomes Very Slow When You Import a Large Number of Hits (298535)


The information in this article applies to:

  • Microsoft Commerce Server 2000
This article was previously published under Q298535

SYMPTOMS

If you import a large number of hits on a daily basis into the Commerce Server 2000 Data Warehouse by using the Web Log Import Data Transformation Server (DTS) task, a severe slowdown may occur in the performance of the import.

CAUSE

The Web Log Import DTS task has the potential to become very slow due to the method in which aggregations are performed. The main factor that contributes to the slowdown is the number of campaign events that a site records.

Large sites (for example, sites that produce approximately 20 million campaign events daily) may experience this problem after only a few days of operation, while smaller sites take longer to experience the problem.

RESOLUTION

To resolve this problem, obtain the latest service pack for Commerce Server 2000. For additional information, click the following article number to view the article in the Microsoft Knowledge Base:

297216 INFO: How to Obtain the Latest Commerce Server 2000 Service Pack

STATUS

Microsoft has confirmed that this is a problem in Microsoft Commerce Server 2000. This problem was first corrected in Commerce Server 2000 Service Pack 1.

MORE INFORMATION

An optimization has been included in Commerce Server 2000 Service Pack 1. This change involves creating temporary tables for the aggregations, instead of updating live aggregate tables.

The following tables are created in the Data Warehouse as part of the optimizations:
  • CampaignItemEventsByDateAndUserTemp
  • RequestByDateByUriByQueryStringTemp
  • HitsInfoTemp
  • HitsByHourTemp
  • UniqueUserKeyByDateTemp
  • LastUriByDateTemp
  • FirstUriByDateTemp
Modification Type:MajorLast Reviewed:10/21/2002
Keywords:kbbetapublic kbbug kbCommServ2000PreSP1fix kbCommServ2000SP1fix kbQFE KB298535
©2002 Microsoft Corporation. All rights reserved.