SMSINST: Install File Script Item May Cause Compile to Stop Responding (305698)

SYMPTOMS

The System Management Server (SMS) Installer may stop responding (hang) during compilation of an installation script when that script contains an install file script item that uses wildcard (*.*) files for the source and specifies the Include sub-directories option on a folder structure that has more than 16 levels.

Additionally, if you cancel the compilation, the SMS Installer may stop and generate an access violation error message.

WORKAROUND

To work around this problem, break the install file script items into multiple install file script items that specify sub-folders below the original folder. This ensures that they include no more than 16 levels of folder structures.

For example, a script may not compile because the folder depth is 17 folders and the Install Files script item is for c:\Myapp\DLL\*.*, include sub-folders. View the sub-folders under C:\Myapp\Dll. There are eight sub-folders, one that goes 16 levels deep. To work around this problem:

Create a single Install File script item for C:\Myapp\Dll\*.*, but do not choose the Include sub-folders option. This is to get all of the files that are at the root of C:\Myapp\Dll, but not the sub-folders.
Create eight Install File script items for each of the eight sub-folders under C:\Myapp\Dll, and specify *.* and the Include sub-directories option.

MORE INFORMATION

The compile process hangs when processing Install file script item for a 16 level deep directory tree structure using wildcards and include sub-directory options.

Steps to Reproduce the Problem

To reproduce the problem, use the following steps:

Install latest SMS Installer build.
Create a folder called C:\Test.
Create 16 sub-folders under this folder. For example, C:\Test\A\B\C\D\E\F\G\H\I\J\K\L\M\N\O\P.
Create a file in the \P (lowest) folder.
Open Installer and start in Script Editor view with no items. Add the following script items to the script:
```
item: Set Variable
  Variable=MAINDIR
  Value=C:\TESTDEST
end
item: Install File
  Source=C:\Test\*.*
  Destination=%MAINDIR%
  Flags=0000000100000010
end
```
Note that wildcards are used for source, and the include subdirs flag is selected. Note that steps 6 through 9 are not vital to reproduce the problem; however, they are necessary to for this simple test script to compile.
In Script Editor view, click the Cancel event in the Event box (Mainline, Exit, Cancel).
Delete the Include Uninstal.ipf script item in the Cancel event script section.
Switch back to the Mainline event.
Click Edit, click Installation Properties, click the Screen tab, and then change the Progress Bar Based on setting to Position in the Installation script.
Compile the script.RESULT: The SMS Installer hangs during the compile; the progress dialog box hangs and there is no activity.
Click Cancel, and then click OK when you are prompted to confirm.RESULT: An error message occurs in the SMS Installer.