Quick Help! Parsing

combs84 · 06-28-2008, 01:59 PM

So I made a thread a while back on how to parse a certain link.

This this the coding I am using. There are 2 sets of code.
________________________________________________
<?php

echo file_get_contents('http://www.superbook.com/seo.txt');

?>

_______________________________________________

<?php

echo file_get_contents('http://www.sportsbook.com/seo.txt');

?></ul>

_______________________________________________

That is the exact code i'm using. You can go here: http://www.cavsreport.com/blog/ and scroll down on the left column, and under FRIENDS is where I have it pasted. You can see the first link WORKS. While the 2nd link comes back with an error that says:

Warning: file_get_contents(http://www.sportsbook.com/seo.txt) [function.file-get-contents]: failed to open stream: HTTP request failed! in /homepages/36/d132896813/htdocs/CavsReport/blog/wp-content/themes/reflections/sidebar.php on line 92
????: NamePros.com http://www.namepros.com/programming/487083-quick-help-parsing.html

My question is..why is this error there? Why does the first coding work, yet the 2nd one fails and gives an error? It does this on every page I put it on. Is it a problem with the actual ad page, even though they are basically the same?

Bruce_KD · 06-28-2008, 03:02 PM

Your code on my server works fine.
It almost looks as if your server's IP has been blocked by the other server.

You may want to contact the owner of that server to see if they have any sort of firewall that may have blocked your server.

Bruce

Peter · 06-28-2008, 03:20 PM

do you have root access on the server? if you do try accessing the page using lynx via ssh.

I agree with Bruce's assumption and doing this would confirm if there was a problem.

Another possibility is that it is taking too long to load and failling.

combs84 · 06-28-2008, 03:23 PM

Wow, I think you're right. That's for checkin that for me. It did would fine on my other site that isn't on those 1and1 servers.

And about root, I can access it using SSh yea. But then what do I do?

Is there a way I can fix this personally without contact my 1and1 server people who leave me on hold for 3 hours and then can't speak english?

Peter · 06-28-2008, 03:40 PM

providing lynx is installed try:-

lynx http://www.sportsbook.com/seo.txt

see what response you get.if your ip is blocked there is nothing you can do bar changing your ip. It could also be a dns issue.

blacknet · 06-29-2008, 07:59 AM

Very Swiftly,

The response is being blocked because they have bot / script detection on the site, to get around this you need to send the HTTP Headers a normal web browser would send.

Give this a go, should work for you

PHP Code:

  <?php

function createContext() {

    $headerstrings = array();

    $headerstrings['User-Agent'] = 'Mozilla/5.0 (Windows; U; Windows NT 5.'.rand(0,2).'; en-US; rv:1.'.rand(2,9).'.'.rand(0,4).'.'.rand(1,9).') Gecko/2007'.rand(10,12).rand(10,30).' Firefox/2.0.'.rand(0,1).'.'.rand(1,9);

    $headerstrings['Accept-Charset'] = rand(0,1) ? 'en-gb,en;q=0.'.rand(3,8) : 'en-us,en;q=0.'.rand(3,8);

    $headerstrings['Accept-Language'] = 'en-us,en;q=0.'.rand(4,6);

    $setHeaders =     'Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5'."\r\n".

????: NamePros.com http://www.namepros.com/showthread.php?t=487083
                    'Accept-Charset: '.$headerstrings['Accept-Charset']."\r\n".

                    'Accept-Language: '.$headerstrings['Accept-Language']."\r\n".

                    'User-Agent: '.$headerstrings['User-Agent']."\r\n";

    $contextOptions = array(

        'http'=>array(

            'method'=>"GET",

            'header'=>$setHeaders

        )

    );

    return stream_context_create($contextOptions);

}

 
echo file_get_contents( 'http://www.sportsbook.com/seo.txt' , false , createContext() );

????: NamePros.com http://www.namepros.com/showthread.php?t=487083
?>

06-28-2008, 01:59 PM	THREAD STARTER #1 (permalink)
combs84 NamePros Regular Join Date: Jun 2005 Location: Michigan Posts: 613	Quick Help! Parsing So I made a thread a while back on how to parse a certain link. This this the coding I am using. There are 2 sets of code. ________________________________________________ <?php echo file_get_contents('http://www.superbook.com/seo.txt'); ?> _______________________________________________ <?php echo file_get_contents('http://www.sportsbook.com/seo.txt'); ?></ul> _______________________________________________ That is the exact code i'm using. You can go here: http://www.cavsreport.com/blog/ and scroll down on the left column, and under FRIENDS is where I have it pasted. You can see the first link WORKS. While the 2nd link comes back with an error that says: Warning: file_get_contents(http://www.sportsbook.com/seo.txt) [function.file-get-contents]: failed to open stream: HTTP request failed! in /homepages/36/d132896813/htdocs/CavsReport/blog/wp-content/themes/reflections/sidebar.php on line 92 ????: NamePros.com http://www.namepros.com/programming/487083-quick-help-parsing.html My question is..why is this error there? Why does the first coding work, yet the 2nd one fails and gives an error? It does this on every page I put it on. Is it a problem with the actual ad page, even though they are basically the same?

06-28-2008, 03:02 PM	#2 (permalink)
Bruce_KD NamePros Member Join Date: Sep 2006 Posts: 99	Your code on my server works fine. It almost looks as if your server's IP has been blocked by the other server. You may want to contact the owner of that server to see if they have any sort of firewall that may have blocked your server. Bruce __________________ Need a CAPTCHA? www.KingdomsDivided.com

06-28-2008, 03:20 PM	#3 (permalink)
Peter NamePros Expert Join Date: Nov 2003 Location: Scotland Posts: 5,069	do you have root access on the server? if you do try accessing the page using lynx via ssh. I agree with Bruce's assumption and doing this would confirm if there was a problem. Another possibility is that it is taking too long to load and failling. __________________ Manage your portfolio using my new Domain Portfolio Management script. Securing Your Domain Name From Theft

06-28-2008, 03:23 PM	THREAD STARTER #4 (permalink)
combs84 NamePros Regular Join Date: Jun 2005 Location: Michigan Posts: 613	Wow, I think you're right. That's for checkin that for me. It did would fine on my other site that isn't on those 1and1 servers. And about root, I can access it using SSh yea. But then what do I do? Is there a way I can fix this personally without contact my 1and1 server people who leave me on hold for 3 hours and then can't speak english? Last edited by combs84; 06-28-2008 at 03:27 PM.

06-28-2008, 03:40 PM	#5 (permalink)
Peter NamePros Expert Join Date: Nov 2003 Location: Scotland Posts: 5,069	providing lynx is installed try:- lynx http://www.sportsbook.com/seo.txt see what response you get.if your ip is blocked there is nothing you can do bar changing your ip. It could also be a dns issue. __________________ Manage your portfolio using my new Domain Portfolio Management script. Securing Your Domain Name From Theft

06-29-2008, 07:59 AM	#6 (permalink)
blacknet NamePros Member Join Date: May 2008 Posts: 181	Very Swiftly, The response is being blocked because they have bot / script detection on the site, to get around this you need to send the HTTP Headers a normal web browser would send. Give this a go, should work for you PHP Code: <?php function createContext() { $headerstrings = array(); $headerstrings['User-Agent'] = 'Mozilla/5.0 (Windows; U; Windows NT 5.'.rand(0,2).'; en-US; rv:1.'.rand(2,9).'.'.rand(0,4).'.'.rand(1,9).') Gecko/2007'.rand(10,12).rand(10,30).' Firefox/2.0.'.rand(0,1).'.'.rand(1,9); $headerstrings['Accept-Charset'] = rand(0,1) ? 'en-gb,en;q=0.'.rand(3,8) : 'en-us,en;q=0.'.rand(3,8); $headerstrings['Accept-Language'] = 'en-us,en;q=0.'.rand(4,6); $setHeaders = 'Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5'."\r\n". ????: NamePros.com http://www.namepros.com/showthread.php?t=487083 'Accept-Charset: '.$headerstrings['Accept-Charset']."\r\n". 'Accept-Language: '.$headerstrings['Accept-Language']."\r\n". 'User-Agent: '.$headerstrings['User-Agent']."\r\n"; $contextOptions = array( 'http'=>array( 'method'=>"GET", 'header'=>$setHeaders ) ); return stream_context_create($contextOptions); } echo file_get_contents( 'http://www.sportsbook.com/seo.txt' , false , createContext() ); ????: NamePros.com http://www.namepros.com/showthread.php?t=487083 ?>

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)