Welcome To The Home Of The Visual FoxPro Experts  
home. signup. forum. archives. search. google. articles. downloads. faq. members. weblogs. file info. rss.
 From: Craig Moore
  Where is Craig Moore?
 
 United Kingdom
 Craig Moore
 To: Fred Cohen
  Where is Fred Cohen?
 Moorestown
 New Jersey - United States
 Fred Cohen
 Tags
Subject: RE: Mystery File
Thread ID: 50883 Message ID: 50968 # Views: 1 # Ratings: 0
Version: Visual FoxPro 6 Category: General VFP Topics
Date: Tuesday, September 07, 2004 1:51:59 PM         
   


It depends on what you need to do, if you need to run reports on the whole lot in one go then you are going to have but them into smaller files, if you need to locate information in them then I would leave them as a text file, I work with a large file of over 60Million records, I keep it in a text file but have created dbf index files containing the unique information and the byte position that it occurs in the text file, then using the fseek() command and a little string manipulation and you have a very quick lookup system.

At all depends on what you need to do with the data.

For viewing large text files there’s only on tool, check out www.fileviewer.com




> > thats a very large file you've been processing.
> >
> > if ever there is a problem processing the file, does it mean that you have to reprocess it again?
> > also, if theres a problem... would you mind openning the large file in an editor and find out what
> > causes the error.
> >
> > heres some tips man:
> >
> > 1. Look for disecting tool for plain text. Otherwise, you could create your tool in Foxpro...
> > 2. process the smaller files instead of the big one. in that way, when you hit an error, you will
> > know what causes the error since the smaller file is easier to load in memmory and could
> > be manage by editors.
> >
> > hmm... i think it would be a very nice tool in foxpro.
> >
> > -Mz
>
> Thanks to both Mak and Mz.
>
> I tried looking at the file with Notebad . . . unsuccessful because file is too large.
>
> I tried opening it in MS Word ... . same result.
>
> I guess I'll junk BIGFILE.DBF and follow your advice by creating smaller files and modifying my analysis programs.
>
> Again, many thanks for the help.
>
> Fred


ENTIRE THREAD

Mystery File Posted by Fred Cohen @ 9/6/2004 9:59:09 PM
RE: Mystery File Posted by Mak Hon Leong @ 9/7/2004 3:25:42 AM
RE: Mystery File Posted by Mz @ 9/7/2004 6:28:15 AM
RE: Mystery File Posted by Fred Cohen @ 9/7/2004 1:31:22 PM
RE: Mystery File Posted by Craig Moore @ 9/7/2004 1:51:59 PM
RE: Mystery File Posted by Pete Sass @ 9/7/2004 2:04:41 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 1:01:19 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 12:58:56 PM
RE: Mystery File Posted by Andy Rice @ 9/7/2004 9:11:13 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 1:02:38 PM