[Req]Extracting Web Content Tutorial[VB]

[Web-Designer]

A while back one of you explained how you extracted the facts off didyouknow.org and I asked you to explain it, they did but didn't explain on how to do it with other websites. . .Could anyone ether post a tutorial on how to extract different web content into your programs and projects, or at least share some links to learn how? It would be very helpful And I'm asking to really explain it in detail, others may not know the web coding/talk so yeah. . .Noob friendly might get more thanks and rep.

(Or just teach me xD)



Thanks. Anyone who actually helps = +Rep +1 Thanks and goes into my soon to be made respected list (Which I don't think means anything really lol)

[NextGen1]

/Moved to tutorial request section.

What are you looking to extract? You can use Elements Collection or RegEx

But, easier to write a sample or a tut if I know what you are looking for.
(by the way, the tut will be in the tuts section, or snippet in the snippets vault)

You can use my example in the snippets vault (towards the end) which shows you how to use elements collection to extract users online at mpgh.

Basic logic once you get that far.

[Web-Designer]

Well I wanted to make a program for runescape, the cheapest game out there lol. . .

I wanted to have it to where I could have The Grand Exchange into my program, like the search and all the items, you search for XX Item and it'll show up on my program. . .I thought about a web browser but I wanna customize it. . .But I also want the first page of it, not just the search. . .This I think would be a lot easier then starting on making my own database of a few million items xD


But I just wanna learn how you do take things off websites, thats basically what I wanna learn. . .Just the overall "How-to"

[Jason]

Well I wanted to make a program for runescape, the cheapest game out there lol. . .

I wanted to have it to where I could have The Grand Exchange into my program, like the search and all the items, you search for XX Item and it'll show up on my program. . .I thought about a web browser but I wanna customize it. . .But I also want the first page of it, not just the search. . .This I think would be a lot easier then starting on making my own database of a few million items xD


But I just wanna learn how you do take things off websites, thats basically what I wanna learn. . .Just the overall "How-to"

When I explained it to you, I also spoke about the methods I used to extract that particular info i.e What to look for? what's common? Where can I find a unique start/end point?

You should be able to apply those concepts to most webpages, I know I do.

[NextGen1]

Feel free to write a tut in the tut section and put a link here
Trying to get all these sections used.

[Jason]

Feel free to write a tut in the tut section and put a link here
Trying to get all these sections used.

Haha I'm not even sure the way I do it is the best way to do it

I'll try dig up the thread and you tell me if my method is effective/correct before I think about writing up a tut. And the whole post was pretty much a tut on it, I explained what concepts I was applying and how I knew what to do what I did etc, I just happened to use didyouknow.org as the example for the tut.

[Web-Designer]

Okay well I just want some kinda tutorial, Ill look up that post where you explained it and go over it again and see if it helps any. . .

[Jason]

Okay well I just want some kinda tutorial, Ill look up that post where you explained it and go over it again and see if it helps any. . .

Well I don't think there is much more to say, if you want a tut it'll have to have a sample project/website you're extracting information from, so it can't be super general. There are main concepts which I explained but that's about it, you just need to find the information and figure out how to get it!

[NextGen(1)]

If I have a chance, I will write one as well.

A) Using Regular Expressions
B) Using "HtmlCollections"
C) HTMLAgilityPack (My Favorite)

[Web-Designer]

Nextgen1 congraz on 4k post and yes that sounds like it'll help, whenever you get a chance no rush. I got like 5 other things to do so yeah lol