[recent "news"] ~
~ [older "news"]
Go to the [most recent news] or go
back where [you came from]
[search
@ fravia], using the amazing
[Namazu]
search engine,
or search using a [quickform], or just
[take a random Link from this page]
This is the "what's new" section of
[searching lore], useful to keep abreast. The exact
names of all pages
that have been updated
are regularly
listed here. As anyone capable of searching the web knows,
[names] have the outmost importance when
mining information on the www. Owners of private and
[public mirrors] can thus fetch directly
all updates through good old
[wget], or
[wgetpro],
or
any [pavuk] site-grabbing facility.
You may also like to have a look at Luc's
and +Forseti own-made mirroring
[bots] and/or scripts. Of course you could use
[teleport-pro] or any other commercial spider
instead,
but in that case you better
be [careful]. Note however that you better read the [warning] below before
attempting any mass downloading from my sites...
Autumn 2006
[How to find anything underneath the commercial
web: Powersearching without google]
Fravia's Lecture
21 October 2006: Hack.lu,
Luxembourg "Bridging ethics and security in computer science"
"Another interesting side effect of a correct web-seeking approach
is that often, when searching for something, you will find on the same servers
many other targets related to your topic, targets that you did not even know existed. We call this
the "being inside the library" effect. Imagine you are not filling out
a request form at the counter, imagine you are physically
retrieving a book inside a library, with
shelves and shelves of books around you and within your immediate reach.
Thus you can scan with your eyes all other books in the proximity: books,
more or less related to the topic you are searching for, that are, imagine,
located on the same shelf, next to your target book
and that you can also pick up at leisure. Gee... the amazing power of knowing how to search!"
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. So you "need" Word, you "need" Excel, etcetera... but...
do you actually have to pay in order to have very good programs?
The answer is NO!
Updated again! (October 2006: wireshark)
Sommer 2006 Holy Holydays! (A small image riddle - to solve before September)
[proxomitron_powerusing.htm]
collated and resuscitated by have
A set of examples and ideas for all proxomitron fanatics. Part of the proxy/proxy essays
section.
If
you publish it, someone will start to write exploits to it - and the propaganda-world
begin to tell terrible things about proxomitron, a software which is IMO a must for every
netizen. But If you don't publish, does it make things better? If
this thread about it should be eased, and the lore left to those able to figure it out alone, would it
make a better future? Or is it better to publish this stuff everyhere - with a patch for the
masses?
[A guide to relative anonymity]
by Mordred, Fravia, art20(iv) and alia Part of the anonymity/anonyweb
sections.
1) buy pc cash elsewhere (not with credit cards and not where they know you);
2) wardrive in another part of the town, not the one you live in;
3) download only, or if you upload, upload only anonymous things or PGP encrypted stuff;
4) rotate your wifi card mac address at every access point;
5) use wardriving laptop ONLY FOR THAT, no personal data whatsoever on it.
[reversing_our_searching_habits.htm]
16 June 2006: Fravia's talk @ the Recon 2006
in Montreal: "Reversing our searching habits -
(Power searching without google)". Part of the workshops
section.
Unfortunately we are now in a phase where even clueless bystanders notice how google is getting spammed much too much. It's usefulness as the "best and only" search engine has been therefore severely reduced.
This is sad, but it does not matter very much: we began long ago to prepare alternative paths to web-knowledge. Let's present some of them -today- to this community of distinguished reversers.
[filehosting.htm]
by Hoyeru (repositories search
lore
for
beginners) Frankly I don't see why people would prefer a torrent instead of using Rapidshare. Updated!
Spring 2006 A tiny searchers' riddle: a small
music snippet that maybe will keep you searching for a little while
[ritz_debunks.htm]: "Link farmers: the snake oil seller kind"
(How to evaluate fake sites)
by Various Authors Part of the Evaluating lore.
"The way i hear him speak indicates that he's talking to an audience that wouldn't know the difference between an ad-infested
labyrinth of cybersquatters and the info (without the dot) they're actually looking for..."
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. So you "need" Word, you "need" Excel, etcetera... but...
do you actually have to pay in order to have very good programs?
The answer is NO!
Updated again! (late April 2006: mp3 encoding)
[winky_stripper.htm]: Winky strips for Yahoo (A Yahoo results stripper)
by Winky ;-) A further introduction to the power of python, by Winky.
Part of the bots
section.
...on the board they where
talking about "stripping" and searching html.
Anyway I decided to make one for yahoo, it is primative a learning tool,
but could be expanded to handle next queries etc.
yahoo_stripper.py -> is the actual script itself
clean.html -> is the "output from the script"
To create the "docs" which reside in the html directory just run the
script thru epydoc.
This sort of tactic of stripping webpages is much more effective then
just blindly using regular expressions.
Not for beginners!
[inphrase.htm]: In Phrase Operators
by Elwood Part of the Password lore. What is an "In Phrase Operator" you'll ask? Well, in fact you already know them.
They are the numrange and the Boolean OR operator.
But did you know they possess a magical searching property? Both can be used within a phrase search.
Winter 2006 (The season Google was spammed too much)
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. So you "need" Word, you "need" Excel, etcetera... but...
do you actually have to pay in order to have very good programs?
The answer is NO!
Updated again! (Winter 2006)
[winky_proxy.html]: A Useless but intesting tool
by Winky ;-) An introduction to the power of python (and of proxies), by Winky.
Part of the Essays about proxying
section.
I purposely have not commented the code. Most code in the wild is not
commented or very sparse commenting. When you read a book every line is
not commented.
If stuck run the code through a debugger see what is happening.
Not for beginners!
[loki_yahoo.htm]: Loki on Yahoo's filter - a short pointer
by Loki
Part of the essays
section.
Lately, all eyes are turned on the diva Google, and every sidestep is
noticed, blogged, commented, flamed etc.. New
interesting features coming out of Yahoo's labs are ignored, MSN sliders
are underused, but nobody misses the latest crappy packaged
solution promoted by Google and his partners.
[Content Based Image Recognition - a stab in PHP] (Part 1)
by Finn61
Part of the essays and of the images
sections.
Even the .edu's aren't giving all this research away.
You will find some doors closed, although I was amazed at how easy it is to find info that people would like you to pay for, freely lying around, sometimes mistakenly, in other places. If you get a closed/pay database that allows you to preview pages of papers,
then you know what to do to find the rest. ;) Warning!: use a proxy when visiting/using this essay.
and
[Content Based Image Recognition - a stab in PHP] (Part 2)
by Finn61
Part of the essays and of the images
sections.
The design I finally decided to go with for image comparison was based on the
frequency of colours in certain regions of the source and target images.
I have chosen this design as a compromise for speed and experimentation.
There are many variables to tweak, some values giving you good results and
others terrible, but I wanted to build in flexibility so we can experiment
and discover what works well for the sources and targets we have in mind.
Warning!: use a proxy when visiting/using this essay.
[A VERY promising spamfighting exercise].
by Loki
Part of the essays
section.
Starting from a given website, try to determine if we're facing pure spam or poor content website.
If it is spam, try to find patterns to gather more information
about the spammer, determine what scheme is used to generate money, what are the technical means to
achieve that, and finally what can be done to terminate the activity of this spammer.
[Searching for DVDs and dvd information]
by Giggle the DVDs Gideon
Part of the essays and of the targets
sections. Alas! In their greed, the commercial powers that be have managed to introduce FOUR commercial scam methods inside the dvd format, whose aim is to restrict the user in various ways: Macrovision & CSS (scrambling techniques), region codes, and disabled user operations (UOPs).
We could add to this the Remove Copy Generation Management System (CGMS) annoying flags which cause DVD recorders to display an error message stating that the source "is copy protected and cannot be recorded" (which of course isn't true)
All these scams can be reversed, the user can thus be able to read his own disks, even if he bought them in Singapore or in Brasil.
[inktomi.html]
Yahoo!/Inktomi's search syntax by Nemo (Updating the older essay inktomi.htm)
Part of the searching essays
section.
No one lights a candle and hides it under a bushel, except Yahoo!
Wizard searching!
[longtermsearching.htm] Long term searching: rules and advice
by Fravia+
Part of the searching essays and of the evaluating essays
sections.
Estote parati!
Time and again, seekers realize that many fellow humans don't even know how to use the exclusion operator on google -
this usually leaves us feeling
hollow, sick, and ashamed that we inhabit the same
planet (let alone that we belong to the same species) as such scum :-) Time to throw some knowledgeballs down the webhills!
Updated again!
[funny.htm]: Funny and weird search engines Ok, this section may result completely irrelevant,
but it is great fun nevertheless... I'm confident that each seeker
has encountered some of these 'weird' search engines.
And maybe it's nice to have a place where to "dump" them. This will demonstrate -again- that
the web is really deep (and really weird).
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. So you "need" Word, you "need" Excel, etcetera... but...
do you actually have to pay in order to have very good programs?
The answer is NO!
Updated again!
[bookmarklets.htm]: Bookmarklets: Weapons for the seeker Have some sharp blades, fellow seeeker...
Sommer 2005 This site has slept awhile: Holy Holydays!
[ritz_google_anti_snoop.htm]
by ritz
"i think this is sneaky and not very nice from mr google. also i wonder since
*when* have they been doing this? i'm quite sure i looked at googles SERPs
some years ago and it wasn't there"
Part of the malware section.
[A talk in Montreal, Canada]
17-19 June 2005: Recon talk
in Montreal: "Wizard searching: reversing the commercial web for fun and knowledge".
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. So you "need" Word, you "need" Excel, etcetera... but...
do you actually have to pay in order to have very good programs?
The answer is NO!
Updated again!
[anonion.htm]: "Anonymity with onions":
how to use TOR for pretty good anonymous browsing
by vvf
Part of the anonymity and of the anonyweb sections. Now, unless you're a ruthless criminal, your browsing is safe. Just don't use anon proxies to do anything really stupid that could land you in a sea of trouble, anon or no anon. Anon proxies should be used like gloves
(to touch sites/servers you don't trust) and/or shades (stay anonymous in the crowd), not like weapons.
The path of the elite windoze xp warrior
by AAVV Part of the Introduction and at the same time of the Classroom sections. Woah, I bet you did not know you had already on your own harddisk
-or could quickly have- all this stuff at your command & disposal...
[opera_java_roma.htm]: Personalising Opera using javascript
by ~Roman
Part of the tutti all'opera section. not only can arbitrary javascript be executed, but also arbitrary executables...
A talk in Dublin, Ireland
20-21 april 2005: Netsoc Internet searching talk at the Trinity
college: "Basic wizard web-searching".
[opera_adding_roma.htm]: Adding functionality to Opera
by ~Roman
Part of the tutti all'opera section.
First we need a way of capturing our incoming and outgoing packets, without
stealing them from
Opera, and without using a proxy... Next we need a program that, given all of our packets, will discard any
non-http ones, and extract
the http headers from those remaining...
The good thing is, this approach is not just limited to viewing headers, but to any application that you can write a C (or any other language)
application for... (For advanced seekers)
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Well ok, once again: you have windows. So you need some programs. You "need" Word, you "need" Excel, etcetera. Do you have to pay something? Do you have to give money to Microsoft?
The answer is NO!
Updated in May!
Everything about
[google] and then some. The "summa" of everything
we know about the most important among the main search engines. by fravia+
The aim of this section, simply stated, is to offer for free, to anyone, a "summa" of all possible knowledge about google.
This should make it completely useless -for anyone- to buy books called "google hacks" and similar.
My hope, and joy, is to put out of business (and hopefully push towards suicide) all the wankers that stole the free content of some good sites in
order to scrap some money out of it.
[../realicra/annoyingsales.htm]: How to counter telemarketing and other pests
by fravia+,
part of the [reality
cracking] section.
"I have some high-yield, tax-free municipals on offer at an
extremely attractive price and virtually no risk.
Are you interested?"
Well, go for it: "Yes! I am very interested! Please send me everything, I'll pay as much
as necessary... let the idiot hope for as long as you manage,
it happens so seldom that he'll wet his pants in anticipation of his 'sales pitch'
... and then, after as long
as you want and manage to play with him, put the phone down IN THE MID of your sentence,
and when he'll phone back (almost immediately, noone cuts the line while speaking, it must have been a
technical glitch) start anew the whole bazaar. Remember that the point is to have them lose their time AND to have fun!
[bangla.htm]: Opening Windows: the
legal approach (or: How do you set up -legally- a full-fledged windows
computer without any money at all) by fravia+ (There's no need to
pay for anything on the web, duh) Part of the Introduction section. Updated!
[rabbits.htm]:
Catching web-rabbits (Catching the rabbit's ears & pulling files out of the hat )
by VVAA,
(Advanced & Qwasy magical Web searching tricks) Updated again!
(search engines rabbits)
[gopherhunt.html]: A very short essay (if it can be called essay) but hopefully you will be able to
sniff out some forgotten lore & maybe even archive it, useful for the less
informedb readers.
by Fugazi (Let's go and hunt for gophers) Old, valuable lore!
[nbbw.c]: Scroogle Scraper
"Google provides a version of their main index to the public that is
free of ads. This is at www.google.com/ie on all of their data centers.
It is apparently used by some versions of Explorer for some feature.
The point is, Google provides this for public use" by Daniel Brandt, Public Information Research Part of the bots section.
[tuttiope.htm]:
Tutti all'opera Updated! (Opera: better than Firefox?)
[freemail.htm]: "free" (sic)
email repositories Only 1 giga or more. Useful for files transfers, for
file sharing and for one-shot emails
[ORIGOGENTISLANGOBARDORUMWAITZ.htm]: Project ORIGO:
Complete collated authoritative text of the ORIGO GENTIS LANGOBARDORUM, by Georg Waitz, SSrrLang, MGH, Hannover 1878: "Countering
Web-ephemerality through Web-eternalness"
by fravia+, part of the text exegesis section.
[introtoprojectorigo.htm]: Introduction to this project.
[intrototheorigo.htm]:introduction to the Origo
(not yet published). Part of the new [fighting against
copyright]
section. Travel back 70 years and become a legal pirate!
[weatherbug.htm]:
Weatherbug's nasty habits (Investigating spyware)
by shinohara, part of the malware.htm
section. (An answer by WeatherBug and a reply by Shinohara)
(c) III Millennium by [fravia+],
all rights reserved and reversed
602 width
600width
598 width
WARNING
My servers are of course configured to monitor activity and deny
access to sites that violate the netiquette guidelines.
Continued rapid-fire requests from any site
after access has been denied (for instance through a 403 Access denied HTTP response)
will be interpreted as a network attack attempt and will
find an according response... without hesitation
and without further warning.
In most cases such erroneus request-processes are run
by well-intentioned but thoughtless
neophytes, ignorant of common sense, yet at times there
have been outright attacks against my sites.
I have no intention of inconveniencing in any way my many
readers just because a small handful of incapable
morons, with neither interest in nor understanding of my actual
content, is utterly incapable of abiding common netetiquette guidelines.
This said, if some specific application, or private mirror, or legitimate spider,
requires relaxation of the above guidelines, contact
[me]
in advance for any attempted download. I'll most probably allow it.
Note that if you misbehave you will earn an automated retaliation: my systems administrators are not responsible for the
consequences of ANY automated download attempt that should try to violate
the
above principles.