Tech. Note 3: Compare/Merge LARGE files/folders
When comparing very large files or folders/file trees, Guiffy may seem to hang. The
user interface will still be responsive - but, the compare view doesn't finish. In such
cases Guiffy probably needs to be allowed to allocate more memory (heap space). Guiffy's
default maximum heap space is 256MB. To monitor Guiffy's memory usage enable the Memory
Meter in the View -> Toolbars... dialog. If Guiffy is running out of memory, follow the
notes below to increase the maximum heap size.
Large Folders/File Trees
For large folder/file tree compares with thousands of files/folders, follow the
instructions below for increasing the maximum heap size.
Guiffy's I/O runtime library supports 64-bit byte addresses - files > 2GB.
Guiffy includes separate algorithms for very large files to minimize memory requirements
and boost performance.
Guiffy's variables for line numbers are 64-bits - line numbers and the metrics such as number
of lines matching > 2GB.
Guiffy's default Show Options (Options -> Show) are setup to implement "Folded Compare/Merge Views"
for Larger files (Over 400KB). "Folded Compare/Merge Views" display only the differences within
a few (default of 10) lines of context. This dramatically reduces the memory and
time required to display large file compares or merges.
Guiffy file compare has been tested on 25GB files with over 2GB lines. In this test only 1 line
But, if you need to see all of the file in the compare view -or- there are very
LARGE differences in the files --- you will need
to give Guiffy more memory to work with.
Edit the guiffy.lax file located in Guiffy's install folder to increase the maximum heap size.
Guiffy's default install paths are:
NOTE: To replace the guiffy.lax file you will need to
open the file as Administrator or SuperUser.
Be sure once you're done and save the guiffy.lax file, the
file is actually updated in the Guiffy install folder.
- Windows: /Program Files/Guiffy
- Linux/Unix: /usr/local/bin/Guiffy
- MacOS: /Applications/Guiffy
Edit guiffy.lax, change the heap.size.max line (usually about line #68).
It will look like this:
Where the 512m above specifies 512MB.
To specify 1GB for example:
Note: Do not change the maximum value to more than 3/4 of your system's RAM (if you set it to
more than the available RAM, thrashing may occur).
On MacOS X the maximum heap size is specified in the guiffy application file's Info Plist.
To change the maximum:
1) Ctrl Click on the guiffy application file
2) Show Package Contents
3) Ctrl click on Info Plist, Open With Property List Editor
4) Edit Root, Java, VMOptions, -Xmx256M
Each of Guiffy's compare/merge views (1st, 2nd, and merge result) are limited to 2 G characters.
If the compare/merge of your large file takes a long time and you know there
are big differences between the files, you may consider tuning the Maximum
Block Size to improve performance.
After the LAX.COMMAND.LINE.ARGS line:
add the line:
Where BBBB= The Maximum Change Block Size in number of lines. A smaller
Maximum Block Size will improve the speed of the compare through large differences
which can even exceed the maximum size. But, smaller Block Sizes may result
in a verbose expression of the differences. The default is 2000.
Guiffy Software, Inc. 2018