A Different Approach...Great Adjustments?

Posts 1–13 of 13 · Page 1 of 1
A Different Approach...Great Adjustments?
Recently , i have been improving the performance of my code , bit by bit. I've looked through many tutorials and learnt much from it. Til now , i am still making adjustments to it , but there is certainly great improvement.

Original Speed:


New Speed:



In order to ensure the program gives me accurate reading of its performance speed , i have made a loop for it to scrape from a page 100 times. Then , i concluded its final average performance speed by dividing the total usernames by the total time taken. As you can see , from 9 usernames per second to 91 usernames per second is a very huge jump. Therefore , in the near future , everyone will be able to scrape as fast as lightning. Anticipate

@Jew This is not a challenge ! Nope Nope !
Quote Originally Posted by Flamegunners View Post
@Ex0rPl4net This is not a challenge ! Nope Nope !
woop woop.

ahk cant multi thread but using my link i can make my code 10 lines long

where is this being scraped from? because in my ideology,if loading one page is 1 second loading 2 pages is 2 so i wonder how this helps...

once i learn some java (next year) i will do 1000/s

Quote Originally Posted by Flamegunners View Post
Anticipate
do you even regex brah?
@Jew I use a dedicated html parsing library.
Quote Originally Posted by Flamegunners View Post
@Ex0rPl4net I use a dedicated html parsing library.
meh, u search by tags?
Quote Originally Posted by Jew View Post
meh, u search by tags?
Its way faster than string manipulation.
Quote Originally Posted by Jew View Post
meh, u search by tags?
Its way faster than string manipulation.
Quote Originally Posted by Flamegunners View Post
Its way faster than string manipulation.
regex is almost instant,and if you separate downloading process and the separating process you can save alot of time!

my website need 2 seconds to download the the html and prase it correctly

using my process i can make my website prase 10 pages and connecting them,so the user doesnt even need to send a request.

if a user requests 100 pages my server is going to maul thru them and display the end result,instead of the user requesting each page seperately
Once ill get more money i can invest in a server with bandwith that does all of that in a fraction of a second
Quote Originally Posted by Jew View Post
Once ill get more money i can invest in a server with bandwith that does all of that in a fraction of a second


You don't have to double post in every single thread.
Quote Originally Posted by Jew View Post
regex is almost instant,and if you separate downloading process and the separating process you can save alot of time!

my website need 2 seconds to download the the html and prase it correctly

using my process i can make my website prase 10 pages and connecting them,so the user doesnt even need to send a request.

if a user requests 100 pages my server is going to maul thru them and display the end result,instead of the user requesting each page seperately
Regex aint good for your health when messing with HTML/XHTML.
Quote Originally Posted by non ame View Post
You don't have to double post in every single thread.
but that post was not relevant to the quote
Regex would be about 1.3 times faster because the user doesn't even need to send a request saving a decent amount of time depending on how fast the servers are.
Quote Originally Posted by goldsilentcat View Post
Regex would be about 1.3 times faster because the user doesn't even need to send a request saving a decent amount of time depending on how fast the servers are.
Posts 1–13 of 13 · Page 1 of 1

Post a Reply

Similar Threads

Tags for this Thread

Need help?