Data source

Questions about the operation or expectations of the NetStumbler software

Postby 138 » Thu May 30, 2002 7:21 am

Oh yeah, every file I have seen starts like this (represented in Hex):

4E 65 74 53 --> "NetS" I assume so NS can verify its one of it's files.

06 --> Have no idea what this is used for.

00 00 00 01 00 00 00 --> This is a file with 1 record. I'm not sure if the record count is 00 00 00 01, or 01 00 00 00. I am leaning towards 01 00 00 00 simply because negative numbers appear to be stored backwords. IE when I am looking for -87, I expect to see FF FF FF A9, but I see A9 FF FF FF instead.
138
Mini Stumbler
 
Posts: 17
Joined: Thu May 30, 2002 5:53 am

Postby blackwave » Thu May 30, 2002 7:39 am

Originally posted by acidrayne


Will probably get that to you tonight after work ... Maybe on lunch if I have time.


Thanks, I will return your email later this evening as well :)
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby blackwave » Thu May 30, 2002 7:41 am

Originally posted by 138
Oh yeah, every file I have seen starts like this (represented in Hex):

4E 65 74 53 --> "NetS" I assume so NS can verify its one of it's files.

06 --> Have no idea what this is used for.

00 00 00 01 00 00 00 --> This is a file with 1 record. I'm not sure if the record count is 00 00 00 01, or 01 00 00 00. I am leaning towards 01 00 00 00 simply because negative numbers appear to be stored backwords. IE when I am looking for -87, I expect to see FF FF FF A9, but I see A9 FF FF FF instead.


In the other thread I was searching for how this format came about, or what it was based on... google came up with a few good findings... but I must search deeper. It is possible that the structure is posted, or cached somewhere. :)

Never give up, Never surrender.
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby sparafina » Thu May 30, 2002 7:57 am

Doesn't Mother (aka author of stumverter) have this worked out?

Mother??
User avatar
sparafina
Mini Stumbler
 
Posts: 1428
Joined: Tue May 07, 2002 2:12 pm
Location: TX,MD,NY

Postby blackwave » Thu May 30, 2002 8:00 am

Originally posted by sparafina
Doesn't Mother (aka author of stumverter) have this worked out?

Mother??


My guess is that they are in cahoots.

Besides just asking Marius and Mother for the answer would be all too easy... and what is the fun in that?
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby Oralis » Thu May 30, 2002 8:00 am

Mother ??..
Oralis
Mini Stumbler
 
Posts: 25
Joined: Tue May 21, 2002 8:40 am
Location: Kansas

NS1 > XML

Postby sparafina » Thu May 30, 2002 8:04 am

Another thought, it would be good to have the option to write out the NS file to XML, that would put it a step towards making it more compatible with the MapPoint .NET services M$ has made available.
User avatar
sparafina
Mini Stumbler
 
Posts: 1428
Joined: Tue May 07, 2002 2:12 pm
Location: TX,MD,NY

Re: NS1 > XML

Postby blackwave » Thu May 30, 2002 8:08 am

Originally posted by sparafina
Another thought, it would be good to have the option to write out the NS file to XML, that would put it a step towards making it more compatible with the MapPoint .NET services M$ has made available.


What would the filesize consideration be?... obviously there currently isn't any form of compression the the current NS1 format since around 5000 AP entries comes out to be around a 30MB file, and as a summary it comes out to be around 588KB, and zipped it comes out to be around 4MB...
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby sparafina » Thu May 30, 2002 8:38 am

Good point. The NS1 file really should be put in a relational database. I've tried walking the DOM on 100 mb files and it is painful. For quick and dirty purposes, such as mapping, the summary file would suffice and you could probably get 5K points in a 1mb XML file, thats doable. I can suck in a summary file and spit it out in GML (geography markup language), but there's lots of work that would need to be done on the MapPoint .NET side of the house.

However, I hate throwing away data, so a database loader or connector would be very handy. This is would make for a better visualization of WiFi distributions, a la the U. of Kansas site.
User avatar
sparafina
Mini Stumbler
 
Posts: 1428
Joined: Tue May 07, 2002 2:12 pm
Location: TX,MD,NY

Postby blackwave » Thu May 30, 2002 8:49 am

Originally posted by sparafina
I hate throwing away data


You couldn't imagine what a data-packrat I am... ;) I seem to have some sort of data-fetish... Some people collect comics, I collect data, in all its binary form..
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby acidrayne » Thu May 30, 2002 8:54 am

Originally posted by blackwave


You couldn't imagine what a data-packrat I am... ;) I seem to have some sort of data-fetish... Some people collect comics, I collect data, in all its binary form..


I find that as cheesy as it may be ... In the words of Mortal Kombat® ...

Knowledge Is Power
Rayne
User avatar
acidrayne
 
Posts: 476
Joined: Wed May 01, 2002 7:04 am
Location: Kansas

Postby sparafina » Thu May 30, 2002 8:59 am

Originally posted by blackwave
You couldn't imagine what a data-packrat I am... ;) I seem to have some sort of data-fetish... Some people collect comics, I collect data, in all its binary form..


Know what you mean, I still have 360K floppy drives in case I have to pull data from some archives.

Still looking for a cheap 9-track because I have stuff stored on tape. I like the way EBCDIC rolls trippingly off the tongue.
User avatar
sparafina
Mini Stumbler
 
Posts: 1428
Joined: Tue May 07, 2002 2:12 pm
Location: TX,MD,NY

Postby sykojester » Thu May 30, 2002 10:10 am

You couldn't imagine what a data-packrat I am... I seem to have some sort of data-fetish... Some people collect comics, I collect data, in all its binary form..


I thought I was alone in the packrat ppl. Now I know there are others out there. People look @ me funny when I say I have 1/2 Terabyte of harddrive space. (and no, I dont run an ISP, hosting service, ect...this is my personal stuff). And my cd collection, oh, god, dont get me started. :)
User avatar
sykojester
 
Posts: 371
Joined: Sat Apr 13, 2002 7:36 am
Location: Tallahassee, FL

Postby blackwave » Thu May 30, 2002 10:17 am

Originally posted by sykojester


I thought I was alone in the packrat ppl. Now I know there are others out there. People look @ me funny when I say I have 1/2 Terabyte of harddrive space. (and no, I dont run an ISP, hosting service, ect...this is my personal stuff). And my cd collection, oh, god, dont get me started. :)


Back in the days I had always feared that someone would take the net down... so I had begun my personal project, codenamed Backup Internet ... since then I have lost track on the amount of data I have stored and housed... all the data tracking programs I have tried have crashed after trying to input all indexes of data.... :(... I have tried mostly also to put this large archive on mo's, and cd's in the event of a world-wide EMF, or EMP announcement... If I could only find a technology that would combine these materials with asbestos so... I would be safe. ... for now I must store all in a concrete room.
-=BW=-
User avatar
blackwave
 
Posts: 4507
Joined: Mon Apr 15, 2002 3:00 am
Location: SoCal, OC

Postby lincomatic » Thu May 30, 2002 10:33 am

Originally posted by 138
Oh yeah, every file I have seen starts like this (represented in Hex):

4E 65 74 53 --> "NetS" I assume so NS can verify its one of it's files.

06 --> Have no idea what this is used for.

00 00 00 01 00 00 00 --> This is a file with 1 record. I'm not sure if the record count is 00 00 00 01, or 01 00 00 00. I am leaning towards 01 00 00 00 simply because negative numbers appear to be stored backwords. IE when I am looking for -87, I expect to see FF FF FF A9, but I see A9 FF FF FF instead.


the integers are reversed because Wintel uses little endian storage order. and same on the pocketpc's...the ARM can be configured for either little or big endian, but MS uses it in little endian mode, so the binary files are compatible w/ the desktops.
~lincomatic
User avatar
lincomatic
Mini Stumbler
 
Posts: 1682
Joined: Tue Apr 16, 2002 12:53 am
Location: Tinsel Town

PreviousNext

Return to Help

Who is online

Users browsing this forum: No registered users and 3 guests