![]() |
Today ! |
Thread Tools | Search this Thread |
|
|
|
|
Junior Member
Posts: 29
Karma:
|
Today I buy a lot of furniture for my new store.
Oh, it take a lot of money. |
|
|
|
|
|
|
|
Witty Title
![]() Posts: 1,497
Name: Dave
Karma:
![]() ![]() ![]()
|
My today was much simplier....work on here, sleep a lot, fool around.
Dave ![]()
__________________
|
|
|
|
|
|
|
|
|
Babe
![]() Posts: 2,477
Name: Cindy
Karma:
![]() ![]()
|
Oooooo
Quote:
__________________
New members - before you post please read the TNT Rules
|
|
|
|
|
|
|
|
|
Elite Member
Posts: 354
Name: The Duke of URL
Karma:
|
Sepulchre, to you specifically:
You might not believe this, but, I came up with YET another engine, MUCH faster than before, but not THAT much different... worlds faster though, hugely! (& it MAINLY depended on IF I used a sorted array or not. The engine I was using before/earlier (variation & improvement on that one I put the source out to here a few pages back even) is equally good on sorted, vs. unsorted arrays, whereas this even NEWER one is only good on sorted ones)... Yes - you probably recall this from academia in working w/ stringlists (just took me a bit to 're-realize' it again is all), or sorts, in the course "datastructures"... See, when the array IS sorted? I quite easily get a 1000x fold speed increase, IF NOT MORE, quite literally by using a SMALL variation in my last motor/engine/algorithm + sorted arrays! E.G.'s (after some time studying it all, via ProcessExplorer & other tools), & FROM THE ORDER OF OPERATIONS YOU MAKE USING IT: ------------------------------------------------------- IMPORTING HOSTS FROM OTHERS & "FORMAT/SCRUB/CONVERSION" PHASE (under NEWEST GUI engine) FROM 127.0.0.1 OR 0.0.0.0, TO PLAIN 0: ------------------------------------------------------- 250,000 RECORDS 1.5 MINUTES... ------------------------------------------------------- LOADING (under NEWEST GUI engine) FOR OTHER PROCESSING: ------------------------------------------------------- 250,000 RECORDS 28 SECONDS ------------------------------------------------------- SEEK-REPLACE/ADD/REJECT ENTRIES (under NEWEST GUI engine): ------------------------------------------------------- 50 SECONDS TO ADD NEW ENTRY or CHECK FOR PRE-EXISTING ONE (vs. one you are trying to add) ------------------------------------------------------- NORMALIZATION (under NEWEST GUI engine - "HUGE IMPROVEMENT" & in its slowest part too): ------------------------------------------------------- 250,000 records NORMALIZED/NO REPEATED LINES IN THE FILE, in 9 minutes time... with a group of HIGHLY repeated items. 250,000 records NORMALIZED/NO REPEATED LINES IN THE FILE, in 30 minutes time (as opposed to 10 days time from the last engine I put up here, which worked but, took WAY too long)... with a group of NONE (& one with nearly none) repeated items (testing total vector time this way). ![]() RAM consumption varied with HOSTS that big & during processing from 67-157mb of RAM max range across diff. HOSTS.TXT file sizes - & as low as 540k... 118 hWnd's (window handle contexts), + 2 Thread multithreaded designed single monolithic .exe file, running on an AMD Athlon64 X2 4800+ CPU @ 2.6ghz stock/oem speed, no overclocks, 512mb PC-400 DDR Ram onboard. ----- * Brainstorming, & observing: IT PAYS OFF - THE SCRUB, LOAD, & SEEK-REPLACE/ADD/REJECT ENTRIES AREA? They're the same, maybe a BIT faster... HOWEVER - The 'artist formerly known as "the slowest part"' (in NORMALIZATION (process of removing repeats) STAGE)? Ha - a HUGE improvement resulted, huge orders of magnitude in less time taken by far! (Now a "little something" to note: I have what is probably very near to the largest HOSTS file out there for public consumption, that is fully normalized... mine is only 533,576 entries (yes, double this dataset, but I would just double its time then to compensate in a LINEAR fashion (most likely its somewhat shorter actually)) THUS... max, a 15 minute - 1/2 hr. wait over a normal-to-largish HOSTS file weighing in @ about 10mb/250,000 entries, & most folks won't have 1/2 of THAT mind you? That small wait, for a perfect no repeats hosts file! (& you end up w/ a HOSTS file w/ the least RAM consumption YET SAME BLOCKING FUNCTIONS for safety + speed, & diskspeed efficient while loading internal format possible inside the file itself, fully alphabetized & normalized too)... APK P.S.=> Heh - world's faster now, & BEST OF ALL, in its formerly slowest part (bigtime, would take days to do the same job this one does in 20 minutes time max)... happy boy here now! ![]() (Soooo, @ this point - I truly am pretty fairly convinced @ this point that I can do no better now, short of going pure DOS/Console mode/tty terminal type of apps, or using inline ASSEMBLER dumps inlined into my code @ this point... as fast as she gets I think, by this point)... apk
__________________
"I'm Reese: Sgt. TechComVN38416, assigned to protect you - You've been TARGETTED FOR TERMINATION!" Last edited by APK; Jun 30, 2008 at 06:28pm. |
|
|
|
|
|
|
|
Elite Member
Posts: 354
Name: The Duke of URL
Karma:
|
Raining like "cats & dogs" today, on & off... so, am continuing my testing of my program above (making 110% sure it is "bulletproof & bugfree", & it appears above, thus, even over 1 million records (1 testset has repeat items, other does not))...
Takes it 3 hours to go thru 1 million ++ records (non-repeated entry version, & far, FAR faster with ones that bear repeat records though)! However, by way of comparison (imo @ least): That's not TOO long to ask imo, for a completely normalized, alphabetized, & most efficient form of line entries there is, for a HOSTS file's entries! ![]() Besides - @ this point? I think I am probably one of a VERY FEW that keeps a HOSTS file of such size (12mb/576,000++ entries as of today), online... E.G./I.E.-> Most folks that are "into" this level of security online (& speed too)? Heck - if they have a 1mb sized - 3.5mb sized HOSTS file, IF THAT?? Well - I'd be surprised... (& it will rip thru THAT size range of a HOSTS file, in the BLINK OF AN EYE, literally (normalizing/removing repeat entries, alphabetizing the entries via a sortation routine, & then allowing you to addon speedup entries to your fav. sites!)) Especially considering I can make a 20mb HOSTS file go down to 12mb, & have it function JUST AS WELL, for both speedups of your fav. sites, & blocking bad sites, also! (AND, with FAR less RAM consumed by it being loaded results in the local DNS cache, & also FAR FASTER LOAD TIMES up from disk too) So far, so good though, all-in-all... & I even updated MOST of the sites (including this one) for others to try it out, in my "HOW TO SECURE Windows 2000/XP/Server 2003 & VISTA" threads I put up across 20++ or so forums online... because this program IS about securing yourself, more than speeding yourself up online (though, it will aid in doing that too)! ----- Then, it's on to addon the ability to download a newly updated HOSTS file, FULLY normalized + alphabetized via this program, built from the most reliable security-site sources, most likely via FTP code! ----- * This is why a coder should NEVER throw away any old code... you'd be surprised when you have to reuse it again (especially if its written completely "TIGHT" & optimized as best you can do it). ----- ![]() (Anyhow/Anyways - That's the rest of my day, today, & hopefully it goes well) APK P.S.=> My HOSTS file was built from completely valid/legit & reliable sources noted thru this thread (wikipedia link on HOSTS files, places like mvps.org & others on that page, & others like SpyBot S&D, for instance) + the "HOW TO SECURE Windows 2000/XP/Server 2003 & VISTA" thread I put out in the Operating Systems section of this & other forums online! E.G.-> SpyBot S&D, spamhaus, phishtank, sri, shadowserver, & others, all noted in my HOSTS file as well in its internal documentation (which IS fully documented as to how to use a HOSTS file) were used to build it, as well as my own research on this (mostly adbanner blocking &/or bad site blocking)... ----- This FTP update (to get a completely NEW & comprehensive protecting HOSTS file) also should not be difficult either... (As I have written up FTP d/l code before (much simpler to do imo, than upload code for FTP), much as the ping section of this was... I had the code already from others apps I built of that nature, too: Some hassles not many though, because I put in code SPECIFIC to the last app it was in (thank goodness I used separate units (like .bas modules in basic, albeit in Object Pascal), made it MUCH simpler to integrate)). ----- Thus, eventually? I'll probably send this to various places that do this type of work (such as mvps.org, & others who put out HOSTS files (whose data I utilized to create my "massive hosts file")), so they too, can "check it out"... & if they like it? That would be good! This application is, OVERALL, meant to be "for the good" of any others that have an interest in security online... This part, I'd give away, for free, literally (because of that)... however, NOT the "Achilles Shield" idea I have above though. I'll send them the variation you see above, minus the FTP download code for a newly updated normalized HOSTS file though... that, I have plans for, as noted above... apk
__________________
"I'm Reese: Sgt. TechComVN38416, assigned to protect you - You've been TARGETTED FOR TERMINATION!" Last edited by APK; Jul 3, 2008 at 06:41pm. |
|
|
|
| Thread Tools | Search this Thread |