Welcome To The Home Of The Visual FoxPro Experts  
home. signup. forum. archives. search. google. articles. downloads. faq. members. weblogs. file info. rss.
 From: Fred Cohen
  Where is Fred Cohen?
 Moorestown
 New Jersey - United States
 Fred Cohen
 To: Pete Sass
  Where is Pete Sass?
 Marathon, Ontario
 Canada
 Pete Sass
 Tags
Subject: RE: Mystery File
Thread ID: 50883 Message ID: 51046 # Views: 1 # Ratings: 0
Version: Visual FoxPro 6 Category: General VFP Topics
Date: Wednesday, September 08, 2004 1:01:19 PM         
   


> > It depends on what you need to do, if you need to run reports on the whole lot in one go then you are going to have but them into smaller files, if you need to locate information in them then I would leave them as a text file, I work with a large file of over 60Million records, I keep it in a text file but have created dbf index files containing the unique information and the byte position that it occurs in the text file, then using the fseek() command and a little string manipulation and you have a very quick lookup system.
> >
> > At all depends on what you need to do with the data.
> >
> > For viewing large text files there’s only on tool, check out www.fileviewer.com
> >
> >
> >
> >
> > > > thats a very large file you've been processing.
> > > >
> > > > if ever there is a problem processing the file, does it mean that you have to reprocess it again?
> > > > also, if theres a problem... would you mind openning the large file in an editor and find out what
> > > > causes the error.
> > > >
> > > > heres some tips man:
> > > >
> > > > 1. Look for disecting tool for plain text. Otherwise, you could create your tool in Foxpro...
> > > > 2. process the smaller files instead of the big one. in that way, when you hit an error, you will
> > > > know what causes the error since the smaller file is easier to load in memmory and could
> > > > be manage by editors.
> > > >
> > > > hmm... i think it would be a very nice tool in foxpro.
> > > >
> > > > -Mz
> > >
> > > Thanks to both Mak and Mz.
> > >
> > > I tried looking at the file with Notebad . . . unsuccessful because file is too large.
> > >
> > > I tried opening it in MS Word ... . same result.
> > >
> > > I guess I'll junk BIGFILE.DBF and follow your advice by creating smaller files and modifying my analysis programs.
> > >
> > > Again, many thanks for the help.
> > >
> > > Fred
>
>
> Then again if you got access to a SQL-Server, or Oracle box; create the table and import the
> entire works.
> Pete from the Great White North. (Only in Canada, ay.) Over and Out ...


Hi Pete:

Long time no see!

Unfortunately I don't have access to either, but many thanks for the suggestions. I'll keep them in mind for future projects.

Fred

Fred Cohen

ENTIRE THREAD

Mystery File Posted by Fred Cohen @ 9/6/2004 9:59:09 PM
RE: Mystery File Posted by Mak Hon Leong @ 9/7/2004 3:25:42 AM
RE: Mystery File Posted by Mz @ 9/7/2004 6:28:15 AM
RE: Mystery File Posted by Fred Cohen @ 9/7/2004 1:31:22 PM
RE: Mystery File Posted by Craig Moore @ 9/7/2004 1:51:59 PM
RE: Mystery File Posted by Pete Sass @ 9/7/2004 2:04:41 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 1:01:19 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 12:58:56 PM
RE: Mystery File Posted by Andy Rice @ 9/7/2004 9:11:13 PM
RE: Mystery File Posted by Fred Cohen @ 9/8/2004 1:02:38 PM