Curl To Grab URL

newsiness · 03-29-2008, 07:06 PM

Code:

<?php

// create a new curl resource
$ch = curl_init();

// set URL and other appropriate options
curl_setopt($ch, CURLOPT_URL, "http://www.llmtrafik.gov.my/showtraffic.aspx?hw=PNB");

// grab URL and pass it to the browser
curl_exec($ch);

// close curl resource, and free up system resources
curl_close($ch);

?>

I am using curl to grab the contents from url llmtrafik.gov.my/showtraffic.aspx?hw=PNB as an example.
Some of the contents (please ignore the images) especially under "Traffic Events" are not displayed by using curl script. Any idea? Please advice.

Thanks!!!

Peter · 03-30-2008, 05:12 AM

it is populated by javascript.

1 disturbing thing I found was the following in the source as well:-

Code:

		<script language="javascript">
			var url = window.location.href;
			if (url.indexOf('/showtraffic.aspx?') >= 0)
				//alert(url.indexOf('/showtraffic.aspx?'))
			else
				document.getElementById('DataGrid2').outerHTML = "I want to f**k you! F**k you! :D";
		</script>

I have slightly edited the words but you can obviously see wht they are.
????: NamePros.com http://www.namepros.com/programming/450950-curl-to-grab-url.html

Should a government website have such things within it's source.

newsiness · 03-30-2008, 03:40 PM

Thanks for the note...

Is it possible to display the contents?

sdsinc · 03-30-2008, 05:38 PM

Originally Posted by newsiness

Thanks for the note...
????: NamePros.com http://www.namepros.com/showthread.php?t=450950

Is it possible to display the contents?

PHP Code:

  $response = curl_exec($ch);

The variable will contain the HTML source code of the remote page

Peter · 03-30-2008, 05:45 PM

Originally Posted by Kath

PHP Code:

  $response = curl_exec($ch); 

????: NamePros.com http://www.namepros.com/showthread.php?t=450950

The variable will contain the HTML source code of the remote page

Did you actually read the thread or look on the page. The content he is after is displayed from javascript after the page loads.

03-29-2008, 07:06 PM	THREAD STARTER #1 (permalink)
newsiness Senior Member Join Date: Jul 2005 Posts: 1,492	Curl To Grab URL Code: <?php // create a new curl resource $ch = curl_init(); // set URL and other appropriate options curl_setopt($ch, CURLOPT_URL, "http://www.llmtrafik.gov.my/showtraffic.aspx?hw=PNB"); // grab URL and pass it to the browser curl_exec($ch); // close curl resource, and free up system resources curl_close($ch); ?> I am using curl to grab the contents from url llmtrafik.gov.my/showtraffic.aspx?hw=PNB as an example. Some of the contents (please ignore the images) especially under "Traffic Events" are not displayed by using curl script. Any idea? Please advice. Thanks!!! __________________ \|\|\|\|newsiness.com\|\|\|\|'""\|""\__,_ \| _[lol]___[lol]____ l \|\|__\|__\|) \|(@)(@)"""""""\|(@)(@)\|(@) 100% Free Online Flash games Last edited by newsiness; 03-30-2008 at 03:08 AM.

03-30-2008, 05:12 AM	#2 (permalink)
Peter NamePros Expert Join Date: Nov 2003 Location: Scotland Posts: 5,069	it is populated by javascript. 1 disturbing thing I found was the following in the source as well:- Code: <script language="javascript"> var url = window.location.href; if (url.indexOf('/showtraffic.aspx?') >= 0) //alert(url.indexOf('/showtraffic.aspx?')) else document.getElementById('DataGrid2').outerHTML = "I want to fk you! Fk you! :D"; </script> I have slightly edited the words but you can obviously see wht they are. ????: NamePros.com http://www.namepros.com/programming/450950-curl-to-grab-url.html Should a government website have such things within it's source. __________________ Manage your portfolio using my new Domain Portfolio Management script. Securing Your Domain Name From Theft

03-30-2008, 03:40 PM	THREAD STARTER #3 (permalink)
newsiness Senior Member Join Date: Jul 2005 Posts: 1,492	Thanks for the note... Is it possible to display the contents? __________________ \|\|\|\|newsiness.com\|\|\|\|'""\|""\__,_ \| _[lol]___[lol]____ l \|\|__\|__\|) \|(@)(@)"""""""\|(@)(@)\|(@) 100% Free Online Flash games

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)