Page 1 of 5

Repairing/Converting/Exporting NS1 Files.

PostPosted: Thu Jan 27, 2005 3:09 pm
by beakmyn
Ok, it sucks when it happens but I may be able to help. Right now, I'm in the process of writing a program that will repair corrupt NS1 files!

The testing so far has gone well but I only have 3 corrupted files. I need more files that have been corrupted naturally, so that I can code the program correctly.

So, here's what I need YOU to do. Zip up your corrupt Ns1 files. Each message should be under 3Mb lest my ISP give me a nasty gram. Then send them to Beakmyn <at> Frontiernet <dot> Net

I will test them with my program and if successful, I'll email you back the fixed ns1 file.

Just to give you an idea of the progress so far:

I've found one corruption that is automagically repaired. I'm still working on writing the records back out into Ns1 format. Not as easy as you'd think since I'm using <cough> Visual Basic <cough> So, it may be a few weeks before you get your file back.

Once tested the program will be released for your enjoyment.

PostPosted: Thu Jan 27, 2005 7:57 pm
by G8tK33per
Don't get me wrong here but didn't you and streaker69 just finish working on this or something similar?

PostPosted: Thu Jan 27, 2005 8:00 pm
by streaker69
G8tK33per wrote:Don't get me wrong here but didn't you and streaker69 just finish working on this or something similar?


Yes, we did, we came up with the procedure, but he and I had talked about this program. I sent him some of my bad and good files to work with since I have over 100 NS1 files, and about 12 bad ones. The procedure should hold people over until he gets the program to work.

I've already played with the Alpha version and it looks really cool, just hung up my machine. I need to download his latest version and try it again.

Beakmyn is definately a very cool guy for writing this thing.

PostPosted: Thu Jan 27, 2005 8:05 pm
by G8tK33per
All good bro...just a quick self-sobriety check. ;)

PostPosted: Thu Jan 27, 2005 8:14 pm
by streaker69
[quote="G8tK33per"]All good bro...just a quick self-sobriety check. ]

You spelled sobriety correctly, obviously you need another beer.

It's almost ready

PostPosted: Fri Jan 28, 2005 4:55 pm
by beakmyn
The program is almost ready for Beta release. Streaker69 has been kind enough to share his logs with me and I'm with each new oddity the program gets better. So, if your too shy to send me your files never fear the program will be out soon.

PostPosted: Sat Jan 29, 2005 8:21 am
by King_Ice_Flash
Have you noticed a patern of what causes the corrupt NS1 files? Such as card type, OS, autosave, autoreconfigure, number of lines in the file, or the type of AP when it corrupted?

PostPosted: Sat Jan 29, 2005 8:52 am
by streaker69
King_Ice_Flash wrote:Have you noticed a patern of what causes the corrupt NS1 files? Such as card type, OS, autosave, autoreconfigure, number of lines in the file, or the type of AP when it corrupted?


In my own experience, files will get corrupt when the system runs out of memory because I've been driving just too damn long. The GPS data from Delorme takes alot of memory and will cause my system to crash after about 4 - 5 hours.

I've also noticed that files get corrupt if AutoSave is turned on in NS. I've also run across two AP's that had corruption in their own SSID, like illegal characters and that will cause the file to become corrupt.

I sent beakmyn about 120 ns1 files dating back to 2002 on the previous version of NS, so he should have a fairly good sample of files to play with.

PostPosted: Sat Jan 29, 2005 12:09 pm
by beakmyn
King_Ice_Flash wrote:Have you noticed a patern of what causes the corrupt NS1 files? Such as card type, OS, autosave, autoreconfigure, number of lines in the file, or the type of AP when it corrupted?



I am seeing some patterns within the ApData/GPSdata which is used in the graphs. I'm seeing some odd values however, I can't confirm them since I've been unable to get Marius to reply to my first email.

Here's what I'm seeing that doesn't agree with the documentation

Location Source values other then 0 or 1
DataRate of 0

The easiest way to fix the apdata is to completely remove it and then the file will open. However, this removed the signal strengths, etc from the graphs.

PostPosted: Sat Jan 29, 2005 2:56 pm
by MikeP928
I cannot wait to see Beakmyn's new sig statistics after social engineering an entire forum out of their files to take over the number one spot on wigle. :D

Your total count should be quit impressive by now. Hey, why drive, just let other people buy all that gas and send you the files. Best assimilation since the borg came thru the neighborhood.

/mikep928 ducks and runs for cover.

PostPosted: Sat Jan 29, 2005 10:01 pm
by G8tK33per
MikeP928 wrote:I cannot wait to see Beakmyn's new sig statistics after social engineering an entire forum out of their files to take over the number one spot on wigle. :D

Your total count should be quit impressive by now. Hey, why drive, just let other people buy all that gas and send you the files. Best assimilation since the borg came thru the neighborhood.

/mikep928 ducks and runs for cover.

Oh, great... there goes my cut...

PostPosted: Thu Feb 03, 2005 9:25 am
by beakmyn
This is Beta software please read the disclaimer screen and back up your files first.
There's also a help file READ IT.

See signature for link.

Latest Version: 0.0.13
Last Exe Uploaded: Feb-8-2005
Last Zip Uploaded: Feb-3-2005

PostPosted: Tue Feb 08, 2005 5:49 pm
by streaker69
Just as a review of Beakmyn's program.

I had about 20 corrupted files that I repaired tonight. It was able to recover all those records. I had a trip to Pittsburgh, and I thought I lost all those records. They have now been added to my own personal database as well as to the group Wigle stats.

This program is great, and was badly needed.. Beakmyn definately deserves some serious kudo's.

Beakmyn, if you're ever in the Lancaster, PA area, let me know we'll go out for some beer.

PostPosted: Tue Feb 08, 2005 11:33 pm
by Dutch
Beakmyn... FRONT AND CENTER!!!

Outstanding job!

Dutch

Version 0.0.16

PostPosted: Wed Feb 09, 2005 5:49 am
by beakmyn
See Last edit date
New version up 0.0.16
Release Format is now tar.feather.gz ;) since some people were having problems with the zip.


Changes:
Consolidated code and removed custom ocx requirement


Kismet to Ns1 translation see other Sticky or webpage!