| Dupli Find version 6.16 Copyright © 1999-2012 RL Vision. All rights reserved

Description | Usage | Working with Multiple Files

Word & Excel support | Unicode Support | Options | Scenarios

About / Contact | Register | Version History | EULA

Description

Dupli Find is a utility that locates duplicate lines/rows in text files, Excel spreadsheets and Word documents. Found duplicates are presented visually and can easily be removed from the source with a minumim of work required. Filtering can be used to only search specific parts of the lines for better results. Dupli Find can also be used as a general text utility that provides many functions for manipulating text files.

Use Dupli Find to...

- Delete duplicate emails in mailing lists.
- Gather statistics from your data files.
- Remove identical rows in Excel workbooks.
- Sort textfiles, ascending or descending.
- Convert from Unix / Mac OS X format to Dos / Windows textfiles.
- Verify sequence generators, where each line in the text file must be unique.
- Merge several files into one, without any duplicate lines.
- Apply blacklists to files, removing unwanted entries.

... and much more! See the scenarios for examples.

Dupli Find is Shareware. Click here to learn how to register and unlock all features!

Using Dupli Find

Using Dupli Find is very easy. Here are the basic steps:

1. Press the "Open" button and select a text file, Excel spreadsheet or Word document that you want to search for duplicate lines. The file will load in the top listbox and then the program begins scanning it for duplicates.

2. Any found duplicate line will be reported in the lower listbox. Click on a duplicate to view the line in the source file.

3. There is a little checkbox next to each duplicate in the list. If you want the program to remove the duplicates for you, select this checkbox. Click on the "Select" button to show a menu where you will find useful ways to automate the selection process.

4. Press the "Save As" button to save the file without the selected lines!

Working with Multiple Files

Dupli Find can load and process several files in one go. After you have opened a file you will be asked if you want to add another file. Select "yes" to add another file, "no" to begin scanning the opened file(s). The files will be loaded one after the other in the same order as they where opened, and then the entire chunk will be scanned for duplicates.

When you choose to save after loading more than one file, you will get to select which file(s) to include when saving. All selected files will be merged into one and saved without the selected duplicates. Files are merged and saved in the same order as they were loaded.

For examples about using multiple files, read the scenarios section.

Note: Enable support for multiple files in the program settings.

Word / Excel support

If you have Microsoft Office installed on your computer, Dupli Find will be able to process Word and Excel files. This works basicly the same way as when processing normal textfiles, although some options will not be available, such as multiple file support and sorting. Dupli Find will only process the text content of each Word line or Excel row, not the formatting.

Note: When loading an Excel file you will be asked which columns to process. Only this column is searched for duplicate rows. But, when you save the file, removing the duplicates that where found, the entire row where the duplicate was found (ie all columns) will be removed!

Note: Dupli Find is a data mining tool. It is not designed to process documents with advanced formatting, tables (in Word), forms, etc. The best efforts have been made to make it work is as many situations as possible, but some documents are too complex to process in this way.

About Unicode Support

Dupli Find can load and process unicode files, but sometimes the conetent is not displayed correctly. Internally though, everything is handled correctly!

Scenarios

Here are some typical scenarios of how Dupli Find can be used to complete a task:

- Removing duplicate emails from a mailing list: This is the most typical example of where Dupli Find is your best friend! Simply load your textfile with emails into Dupli Find and let it process the file. When it is ready, use the select button and "select all but first duplicate". Now save the file again, and you will have a file containing only unique emails!

- Joining several mailinglists: Say that you have several mailing lists, and you want to join them into one, keeping only unique emails. Open the first file you want to use. Dupli Find will now ask if you want to add another file. (Make sure that you have enabled support for multiple files in the settings.) Choose yes and repeat until you have added all the mailing list files. Now let Dupli Find locate all duplicate lines. Press the select button and choose "all but first". Press the save button. Dupli Find will now ask which files to include when saving. Select all files and press ok. When you save, all files will be merged into one, and only the first of each duplicate emails be saved.

- Removing lines from a file, if the lines are also present in a separate file: Say that you have two files. You want to remove lines from the first file, if the line is also present in the second file. (An example of where this can happen is if you have a mailing list with emails, and another list with opt-out emails that are to be removed from the mailing list.) Open the first file in Dupli Find. The program will ask if you want to add another file. Select yes and load the second file too. Now let Dupli Find search for duplicate lines. The duplicates that are found will be lines that are present in both files (this assumes that the first file only contains unique lines). Press the select button, and choose "select all duplicates". Now save the file. You will be asked which files to include when saving. Choose to only include the first file. This way you will save the first file again, but the lines that are present in both files will not be saved!

- Extracting content from the lines: This is a good example of how you can use Dupli Find as a general text utility, rather than only to find duplicate line. When you load your files you have the option to apply a pre-processing filter. Using this filter you can strip out only parts of the line. Then, when you save the file, you can save this filtered content instead of the original. Note that you are not required to select any duplicates found (if any), so your file will still contain all lines when saving!

- Sorting a textfile: Sometimes you want to have a textfile sorted alphabetically. Dupli Find can do this for you. Simply enable the sorting option in the save window, and your files you save will be sorted, either ascending or descending! Remember that if you don't select any duplicates, all lines will be included when you save the file!

- Converting Unix/Mac OS X textfiles to Dos/Windows format: Unix and Mac OS X do not save textfiles in the same way as Windows. This is a common problem if you for example have a Linux webserver and you download files created on this server using ftp. These file will appear as one single line when for example opening them in NotePad. Dupli Find has a built in converter for these files. Simply open the file in Dupli Find and then save it again (without selecting any duplicate line). Dupli Find will always save files using Windows formatting, so now you should have a file that you can use in other Windows programs!

- Verifying serial number generators: If you are a developer doing a serial number generator you want to be sure that each generated code is uniqe. Simply load a list of serials into Dupli Find, and if it doesn't find an duplicate, then you are a good programmer!

About RL Vision

|  | Dupli Find was developed by RL Vision. Website: http://www.rlvision.com Click here for contact information.

Register

Dupli Find is shareware. You can try it for free to make sure that it works for you, then you must register to continue using it.

The unregistered version will only display the first 5 found duplicate lines - the rest will be hidden. Other than that, everything works as intended. When you register, this limitation will be removed so you can see (and remove) all duplicates.

When you register a serial number will be sent to you by email. This should be entered into Dupli Find by choosing "enter registration code" at the shareware notice window. The program will instantly enter registered mode!

Click here to register Dupli Find!

Version History

| 1.0 |  | First public release! Released: 1999-??-??

| 1.1 |  | Added: Copy to clipboard (right click on duplicate lines) Fixed: Nasty bugs that prevented the program to work as intended. Fixed: The usual bugfixes... Released: 1999-10-16

| 1.11 |  | Changed: New email address! Released: 2000-11-14

| 1.2 |  | Added: Case sensitive checkbox! Fixed: Couldn't open files with hidden or protected attribute Fixed: Bug when scanning several scan in a row Changed: Interface enhancements Changed: Skips lines with only spaces Released: 2001-02-11

| 1.3 |  | Added: The program can now remove duplicate lines automatically! Changed: Tweaked the interface a little bit. Changed: Updated the manual a bit and added "usage" section. Released: 2001-08-14

| 1.4 |  | Added: Settings window Added: "Trim Lines" setting Added: "Include Empty Lines" setting Released: 2001-08-26

| 2.0 |  | Added: Command Line Support! Added: Support for huge files (Larger than 32768 lines) Added: Copy All Added: Copy Selected Added: Shows more information after scanning files Added: Settings Are Saved! Added: A little statistics in the about window Added: Complete installer & uninstaller! Added: % indicator when loading and scanning files Fixed: Now you can overwrite the original file when saving! Fixed: Progress Meter is more accurate now (although still a bit jerky) Fixed: Speed optimizations Fixed: A couple of crash bugs removed Changed: Converted manual to html Changed: New about dialog Changed: Program is now shareware Changed: Released on rlvision.com Released: 2003-05-06

| 2.1 |  | Added: View window Released: 2003-08-09

| 2.5 |  | Added: Option to trim lines when saving. Added: Option to not save empty lines. Added: Drag'n'Drop Support. Added: 5 new command line switches: /c /r /e /m /t Fixed: Some bugs Released: 2004-07-26

| 2.51 |  | Fixed: Bug occurring on Windows 2000/XP Released: 2004-07-29

| 2.52 |  | Fixed: Crash that sometimes happened during shutdown Fixed: Some visual bugs, mainly visible on Windows XP Released: 2005-01-02

| 3.0 |  | Changed: New scanning & saving engine, extremely fast! Added: Select button. Added: Start offset option. Added: Regular expression options. Added: Copy to Clipboard window. Changed: Memory optimizations. Changed: Visual enhancements. Fixed: Many smaller bugs & tweaks. Released: 2005-03-15

| 4.0 |  | Added: Support for loading multiple files! Added: Support for Word and Excel files! Added: Scripting support! (replaces RegExp) Added: Sorting lines when saving. Added: Save duplicates to file. Added: Options to disable warnings. Added: Support for unix format textfiles. Changed: Viewer integrated into main window. Changed: Improved command line support. Changed: Can save even if no duplicates are found or selected. Changed: Better statusbar info. Released: 2006-01-14

| 4.1 |  | Added: XP Themed interface! Added: "Select all but first x duplicates" Added: "Select all but last x duplicates" Fixed: Bugs & tweaks. Released: 2006-06-03

| 5.0 |  | Changed: Many improvements to user interface for a more intuitive way of working. Added: Load and save dialogs with options that were previously located in the settings. Added: New load options: Ignore whitespace & ignore empty lines. Added: Pre-Processing filters in load & save options. Added: Bubble tooltips with convenient help. Added: Quickstart image for first time users. Added: Duplicate frequency listing in tools window. Added: Support for all kinds of Word & Excel filetypes, including the new docx/xlsx. Added: New select mode: all/none of marked kind. Fixed: Major bugfixes and improvements to Word and Excel support! Fixed: Better compatability with 64-bit systems. Changed: Removed scripting and advanced command line support (might return on request). Changed: Unregistered now allows saving, but is limited to finding max 5 dups instead. Released: 2009-05-22

| 6.0 |  | Added: Include / Exclude filter in load options! Added: "Advanced Filter" to pre-processing filter! Added: Color coding of duplicates makes them easier to read! Added: Option to 'copy not selected' duplicates in the Tools window Added: Keyboard shortcuts for select menu (Ctrl+F1 - Ctrl+F9) Changed: Clicking on line in source jumps to duplicate Changed: "Disable display" in settings can now be turned off by entering 0 Changed: Some visual enhancements for more intuitivity Fixed: Minor bugs Released: 2010-10-20

| 6.1 |  | Changed: More whitespaces are now trimmed Fixed: Various small bugs and tweaks. Released: 2011-05-17

| 6.11 |  | Fixed: Bug preventing Office files to be opened if file extension was not in lower case. Released: 2011-07-17

| 6.12 |  | Fixed: A bug that prevented saving when using the "reduce memory" option. Released: 2012-01-02

| 6.15 |  | Fixed: UFT-16/UTF-32 saving works better, but will warn before saving. Released: 2012-01-04

| 6.16 |  | Fixed: Could not save when using the "reduce memory" option. Fixed: Could not save preprocessed content in some cases. Released: 2012-06-05

End User License Agreement (EULA)

``

RL VISION END USER LICENSE AGREEMENT

1. Distribution

This shareware software may be freely distributed, provided that: 1. Such distribution includes only the original archive supplied by RL Vision. You may not alter, delete or add any files in the distribution archive. 2. The distribution does not include a registration number. In particular, you may not distribute a registered piece of software. 3. No money is charged to the person receiving the software, beyond reasonable cost of packaging and other overhead.

2. License

By receiving and/or using RL Vision software, you accept the following Evaluation and Registered User Agreement. This agreement is a binding legal agreement between RL Vision and the purchasers, users or evaluators of RL Vision's software and products. IF YOU DO NOT INTEND TO HONOR THIS AGREEMENT, TERMINATE THE SOFTWARE INSTALLATION NOW.

3. Evaluation (Unregistered) and Registered User Agreement

3.1. Unregistered shareware use

You may evaluate the Shareware program for maximum of thirty calendar days, after which you must register the program with RL Vision or remove the software from your computer.

You may allow other users to evaluate copies of the unregistered Shareware. All evaluation users are subject to the terms of this agreement.

3.2. Usage and distribution restrictions

The evaluator/user/buyer/owner may not use or distribute RL Vision's software for any unlawful purpose.

The evaluator/user/buyer/owner is not allowed to attempt to reverse engineer, disassemble or decompile RL Vision Software and products.

3.3 Copyright restriction

All parts of RL Vision software and products are copyright protected. No program, code, part, image, video clip, audio sample, text or computer generated sequence of images may be copied or used in any way by the user except as intended within the bounds of the single user program.

3.4. Limitation of responsibility

The evaluator/user/buyer/owner of RL Vision software will indemnify, hold harmless, and defend RL Vision against lawsuits, claims, costs associated with defense or accusations that result from the use of RL Vision software.

RL Vision is not responsible for any damages whatsoever, including loss of information, interruption of business, personal injury and/or any damage or consequential damage without limitation, incurred before, during or after the use of our products. Our entire liability, without exception, is limited to the customers' reimbursement of the purchase price of the software (maximum being the suggested retail price as listed by RL Vision) in exchange for the return of the product, all copies, registration papers and manuals, and all materials that constitute a transfer of ownership from the customer back to RL Vision.

3.5. Licensed software restrictions

Each registered copy of the RL Vision software may be used in only one single location by one user. Use of the software means that you have loaded the program and run it or have installed the program onto a computer. If you install the software onto a multi-user platform or network, each and every individual user of the software must be registered separately.

You may make one copy of the registered software for backup purposes, providing you only have one copy installed on one computer being used by one person. If any person other than yourself uses RL Vision's software registered in your name, regardless of whether it is at the same time or different times, then this agreement is being violated!

The sale of and or distribution of registered copies of this software is strictly forbidden. It is a violation of this agreement to loan, rent, lease, borrow, or transfer the use of registered copies of RL Vision Software products.