juust ~ php oddities » serp http://www.juust.org Unordered list of one element Thu, 02 Sep 2010 16:58:24 +0000 http://wordpress.org/?v=2.8 en hourly 1 quick note : serp plugin beta http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/ http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/#comments Wed, 02 Sep 2009 17:47:40 +0000 juust http://www.juust.org/?p=724 I am developing a new google serp plugin for wordpress. I developed it over the weeknd on wp2.8, it should run on anything with a ’shutdown’ hook and jquery. I will be adding some other stuff to it over the next few weeks, but I thought I’d put a beta on the blog. If you try it, I hope it runs, send some feedback.

If you have some ideas about cool features drop me a note, I might put it in there. I was pondering on a rest service to pool sem-data and develop some competitor analysis functionality, but that is just a vague idea.

]]> http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/feed/ 3 bing http://www.juust.org/index.php/bing-serp/2009/08/ http://www.juust.org/index.php/bing-serp/2009/08/#comments Fri, 21 Aug 2009 02:46:06 +0000 juust http://www.juust.org/?p=704 for completeness : php bing serp scraping :

  1. $query = 'serp';
  2. $page = 1;
  3. $start = ($page-1)*10;
  4. $url = 'http://www.bing.com/search?q='.urlencode($query)."&first=".($start+1);
  5.  
  6. $curl_handle = curl_init();
  7. curl_setopt($curl_handle,CURLOPT_URL, $url);
  8. curl_setopt($curl_handle,CURLOPT_CONNECTTIMEOUT,2);
  9. curl_setopt($curl_handle, CURLOPT_RETURNTRANSFER, 1);
  10. $return = curl_exec($curl_handle);
  11. curl_close($curl_handle);
  12.  
  13. $parts = split('<h3>', $return);
  14.  
  15. for($j=1;$j<count ($parts);$j++)
  16. {
  17.     $p=$parts[$j];
  18.     preg_match('#<a\s+.*?href=[\'"]([^\'"]+)[\'"]\s*(?:title=[\'"]([^\'"]+)[\'"])?.*?>((?:(?!).)*)#i', $p, $urls);
  19.     echo "position: ".($start +$j)." url: ".$urls[1]." title: ".$urls[3].'<br />';
  20. }
  21. </count></h3>
]]> http://www.juust.org/index.php/bing-serp/2009/08/feed/ 1 serp tool http://www.juust.org/index.php/serp-tool/2008/11/ http://www.juust.org/index.php/serp-tool/2008/11/#comments Mon, 03 Nov 2008 22:20:49 +0000 juust http://www.juust.org/?p=208 I was putting together a serp tool with a database and an emailer on a cronjob, mainly because I am lazy, I always get cranky when I have to type in these keywords again, I ain’t a teletubby.

I wanted an automated one with a history that sends me an email every day, so I started putting on together but I got distracted because the gethost server was shut down and my moms Mary Chapel event blog was on it. My old site was also on it, with my crappy blog, but losing that ain’t half as bad as losing yer moms Mary Chapel blog, that is bad karma.

So I got her a domain and put it on one of my accounts, installed a new blog and made sure it ranks number one in google again. Apart from that I was putting together a scraper and still needed some cron jobs for the scraper scripts.

I found a nice free cron job site, standard 5 jobs a day. It’s free and it works flawless, no hassles. Very nice.

Once I had that I remembered I still had to finish that serp thing as well, so I finished the basic routines today. Still needs some testing, and it could use the yahoo and msn serps. I’ll grab them from a wordpress widget and add some language options, after that it should be a fine tool.

I’ll put the scripts up for download in two or three weeks or something.

]]> http://www.juust.org/index.php/serp-tool/2008/11/feed/ 2 serp tool 2008 http://www.juust.org/index.php/serp-tool-2008/2008/09/ http://www.juust.org/index.php/serp-tool-2008/2008/09/#comments Sun, 21 Sep 2008 23:55:09 +0000 juust http://www.juust.org/?p=152 I never got around to building a serp tool with a mysql backend, one on a cronjob with an email option.
This weekend I got an OSWD free template, then it at least looks like a website. I develop a lot easier when it has a template. Filling in the blanks.

Often if you program a rough sketch, in time it sort of develops itself. If you don’t start nothing gets done.

I am developing it on juust.org/serp/, once its finished i’ll put one on trismegistos.net and put the source up for download.

It’s flimsy but the idea of a serp minisite with emailer option is commercially attractive.

It’s also important for the blog to have a ’serp’ page in the menu, and a serp page should have serp tools, in abundance, all kinds of them.

]]> http://www.juust.org/index.php/serp-tool-2008/2008/09/feed/ 0 wordpress serp widget serpent http://www.juust.org/index.php/serpent-wordpress-widget/2008/07/ http://www.juust.org/index.php/serpent-wordpress-widget/2008/07/#comments Mon, 21 Jul 2008 03:37:30 +0000 juust http://www.juust.org/?p=62 28-7
the permutation serp creates too much of a load and the results are 90% general so not very usefull per page.

  • replaced it with a straight top-50 serp on the msn, yahoo, google engines
  • using post_tags
  • added a link to the search engine result pages themselves
  • added a cache and a timer on 6000seconds, it requeries every 1.5 hours when a page is opened and in the meantime dishes out cached results, to minimize queries and page load times
  • added before_widget and after_widget

it needs

  • specific options per engine (language etc.)
  • a dig option up to 1000 result
  • css hooks
  • max three keywords constraint
  • page keywords list (currently only posts’ tags are used)
  • a mysql backend (I don’t want the nonsense in the wordpress db)
  • a counter for used queries (otherwise you get ‘no result’)
  • an archive report to see how the serp results develop

but it’s a start

the results are accurate but i need a once a day routine to grab the keyword of the index page and other pages (the ‘keywords’ section is often dynamic and changes every day, most sites use plugins to either grab all tags of listed posts and put them in the meta-section as page-keywords, or use headspace to override it with a fixed set.)

querying the wordpress database and for all non-post page use get_meta_tags, put url and tags in a cached list and serp the lot once a day would solve that.

something like that.

once I got that fixed i’ll ask some people to test it.

]]> http://www.juust.org/index.php/serpent-wordpress-widget/2008/07/feed/ 0 serp pagerank php seo tool http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/ http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/#comments Wed, 09 Jul 2008 01:23:02 +0000 juust http://www.juust.org/?p=33 So how did I do with a few days search engine optimisation ? not bad at all, on php+serp nicely on second spot behind shoemoney.com and on serp+php also front page, and on the 5 keys overall 13th. not bad for a PR0 domain.

5-key serp : serp pagerank php seo tool

count hits domain
7.8 8 www.juust.org
16 serp pagerank http://www.juust.org/ 0.2
8 serp php http://www.juust.org/ 1
9 serp php http://www.juust.org/index.php/php-serp-scripts/2008/07/ 1
99 serp tool http://www.juust.org/ 0.2
42 pagerank serp http://www.juust.org/ 0.2
3 php serp http://www.juust.org/ 3
4 php serp http://www.juust.org/index.php/php-serp-scripts/2008/07/ 2
70 seo serp http://www.juust.org/ 0.2

and who are the competition :

points results domain
20.2 13 www.seochat.com
16.6 21 www.seocompany.ca
15.6 13 sitening.com
14.6 10 www.webconfs.com
13.4 21 forums.digitalpoint.com
11.4 11 www.prchecker.info
11 4 en.wikipedia.org
10 19 www.webmasterworld.com
9 4 www.cristiandarie.ro
8.8 8 www.seroundtable.com
8.4 5 www.shoemoney.com
8.4 5 www.google.com
7.8 8 www.juust.org
7.6 6 tools.seobook.com
7.2 9 www.jumptags.com
7.2 14 www.seomoz.org
7 7 www.seoserp.com
6.4 14 forums.seochat.com
6.4 10 link.ezer.com
6.4 4 www.ljfind.com
5.8 7 www.iwebtool.com

Now, for the seo+tool niche… an online trackback spider…

]]> http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/feed/ 0 php serp scripts http://www.juust.org/index.php/php-serp-scripts/2008/07/ http://www.juust.org/index.php/php-serp-scripts/2008/07/#comments Mon, 07 Jul 2008 12:51:19 +0000 juust http://www.juust.org/?p=28 Some basic PHP search engine result page scripts (always come in handy for yer basic seo adventures).

MSN Serp

  1. $first=1;
  2. $query="php+serp";
  3. $count=50;
  4.  
  5. $xml = @simplexml_load_file("http://search.live.com/results.aspx?q=$query&count=$count&first=$first&format=rss");
  6. foreach($xml->channel->item as $i) echo $i->link."<br />";

www.tellinya.com has another version for non-simplexml servers (uses curl and the ehttp.client class, the technique is closer to a sequential line parser so sometimes its more practical (hint:blog-pipe parsing with “streams”).

Yahoo Serp

  1.  
  2.         $varkeywords=$_GET["keywords"];
  3.         $vardomain=$_GET["domain"];
  4.        
  5.  
  6.         $strResult='';
  7.         $strHitsResult='';
  8.         $strHitsCount=0;
  9.         $strHits='';
  10.  
  11.         $start = 1;
  12.         $numberofresults = 10;
  13.         for($ii=0; $ii&lt;20; $ii++) {
  14.             $jj=$ii*$numberofresults+1;
  15.             $kk=$jj+$numberofresults;
  16.  
  17.         $vargoogleresultpage = "http://search.yahoo.com/search?p=".urlencode(trim($varkeywords))."&ei=UTF-8&fr=sfp&xargs=0&pstart=1&b=".$jj;
  18.             flush();  
  19.            
  20.             $googleresponse = join("",file($vargoogleresultpage));
  21.         $googlehits = preg_split('/<a class=\”yschttl\” /', $googleresponse, -1, PREG_SPLIT_OFFSET_CAPTURE);
  22.             foreach($googlehits as $googlehit){
  23.             $i++;
  24.             preg_match("/href=\"(.*?)\"/", $googlehit[0], $t, PREG_OFFSET_CAPTURE);
  25.                
  26.                
  27.             if($i > 1){
  28.                 $serp = $i-1;
  29.                 $SearchForDomain = "~".$vardomain."~i";
  30.                     if(preg_match($SearchForDomain, $t[1][0])){
  31.                     $strHitsCount++;
  32.                     $strHits .= $serp .', ';    
  33.                     $strResult=$strResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  34.                     $strHitsResult = $strHitsResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  35.                             } else {
  36.                                     $strResult=$strResult.$serp."</a><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a><br />";
  37.                                     }
  38.                         }
  39.            }
  40.         }
  41.         echo $strHits.' total = '.$strHitsCount.' <br />';
  42.         echo $strHitsResult;
  43.         echo '<br /><br />full list :<br />';
  44.  
  45.         echo $strResult;

Google SERP

  1.         $varkeywords=$_GET["keywords"];
  2.         $vardomain=$_GET["domain"];
  3.        
  4.  
  5.         $strResult='';
  6.         $strHitsResult='';
  7.         $strHitsCount=0;
  8.         $strHits='';
  9.  
  10.         $start = 1;
  11.         $numberofresults = 100;
  12.         for($ii=0; $ii&lt;11; $ii++) {
  13.             $jj=$ii*100+1;
  14.             $vargoogleresultpage = "http://www.google.com/search?as_q=".urlencode(trim($varkeywords))."&num=".$numberofresults."&start=".$jj."&hl=en&lr=lang_en";
  15.             flush();
  16.            
  17.             $googleresponse = join("",file($vargoogleresultpage));
  18.         $googlehits = preg_split('/class=r><a /', $googleresponse, -1, PREG_SPLIT_OFFSET_CAPTURE);
  19.             foreach($googlehits as $googlehit){
  20.                 $i++;
  21.                 preg_match("/href=\"(.*?)\"/", $googlehit[0], $t, PREG_OFFSET_CAPTURE);
  22.                
  23.                
  24.                 if($i > 1){
  25.                         $serp = $i-1;
  26.                         $SearchForDomain = "~".$vardomain."~i";
  27.                         if(preg_match($SearchForDomain, $t[1][0])){
  28.                             $strHitsCount++;
  29.                             $strHits .= $serp .', ';    
  30.                             $strResult=$strResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  31.                             $strHitsResult = $strHitsResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  32.                             } else {
  33.                                     $strResult=$strResult.$serp."</a><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a><br />";
  34.                                     }
  35.                         }
  36.            }
  37.         }
  38.         echo $strHits.' total = '.$strHitsCount.' <br />';
  39.         echo $strHitsResult;
  40.         echo '<br /><br />full list :<br />';
  41.  
  42.         echo $strResult;

MSN (being microsoft) don’t encourage commercial use of the rss-feed.

]]> http://www.juust.org/index.php/php-serp-scripts/2008/07/feed/ 1