juust ~ php oddities » serp http://www.juust.org Unordered list of one element Thu, 02 Sep 2010 16:58:24 +0000 http://wordpress.org/?v=2.8 en hourly 1 quick note : serp plugin beta http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/ http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/#comments Wed, 02 Sep 2009 17:47:40 +0000 juust http://www.juust.org/?p=724 I am developing a new google serp plugin for wordpress. I developed it over the weeknd on wp2.8, it should run on anything with a ’shutdown’ hook and jquery. I will be adding some other stuff to it over the next few weeks, but I thought I’d put a beta on the blog. If you try it, I hope it runs, send some feedback.

If you have some ideas about cool features drop me a note, I might put it in there. I was pondering on a rest service to pool sem-data and develop some competitor analysis functionality, but that is just a vague idea.

]]> http://www.juust.org/index.php/wordpress-serp-plugin-beta/2009/09/feed/ 3 bing http://www.juust.org/index.php/bing-serp/2009/08/ http://www.juust.org/index.php/bing-serp/2009/08/#comments Fri, 21 Aug 2009 02:46:06 +0000 juust http://www.juust.org/?p=704 for completeness : php bing serp scraping :

  1. $query = 'serp';
  2. $page = 1;
  3. $start = ($page-1)*10;
  4. $url = 'http://www.bing.com/search?q='.urlencode($query)."&first=".($start+1);
  5.  
  6. $curl_handle = curl_init();
  7. curl_setopt($curl_handle,CURLOPT_URL, $url);
  8. curl_setopt($curl_handle,CURLOPT_CONNECTTIMEOUT,2);
  9. curl_setopt($curl_handle, CURLOPT_RETURNTRANSFER, 1);
  10. $return = curl_exec($curl_handle);
  11. curl_close($curl_handle);
  12.  
  13. $parts = split('<h3>', $return);
  14.  
  15. for($j=1;$j<count ($parts);$j++)
  16. {
  17.     $p=$parts[$j];
  18.     preg_match('#<a\s+.*?href=[\'"]([^\'"]+)[\'"]\s*(?:title=[\'"]([^\'"]+)[\'"])?.*?>((?:(?!).)*)#i', $p, $urls);
  19.     echo "position: ".($start +$j)." url: ".$urls[1]." title: ".$urls[3].'<br />';
  20. }
  21. </count></h3>
]]> http://www.juust.org/index.php/bing-serp/2009/08/feed/ 1 serp tool http://www.juust.org/index.php/serp-tool/2008/11/ http://www.juust.org/index.php/serp-tool/2008/11/#comments Mon, 03 Nov 2008 22:20:49 +0000 juust http://www.juust.org/?p=208 I was putting together a serp tool with a database and an emailer on a cronjob, mainly because I am lazy, I always get cranky when I have to type in these keywords again, I ain’t a teletubby.

I wanted an automated one with a history that sends me an email every day, so I started putting on together but I got distracted because the gethost server was shut down and my moms Mary Chapel event blog was on it. My old site was also on it, with my crappy blog, but losing that ain’t half as bad as losing yer moms Mary Chapel blog, that is bad karma.

So I got her a domain and put it on one of my accounts, installed a new blog and made sure it ranks number one in google again. Apart from that I was putting together a scraper and still needed some cron jobs for the scraper scripts.

I found a nice free cron job site, standard 5 jobs a day. It’s free and it works flawless, no hassles. Very nice.

Once I had that I remembered I still had to finish that serp thing as well, so I finished the basic routines today. Still needs some testing, and it could use the yahoo and msn serps. I’ll grab them from a wordpress widget and add some language options, after that it should be a fine tool.

I’ll put the scripts up for download in two or three weeks or something.

]]> http://www.juust.org/index.php/serp-tool/2008/11/feed/ 2 serp tool 2008 http://www.juust.org/index.php/serp-tool-2008/2008/09/ http://www.juust.org/index.php/serp-tool-2008/2008/09/#comments Sun, 21 Sep 2008 23:55:09 +0000 juust http://www.juust.org/?p=152 I never got around to building a serp tool with a mysql backend, one on a cronjob with an email option.
This weekend I got an OSWD free template, then it at least looks like a website. I develop a lot easier when it has a template. Filling in the blanks.

Often if you program a rough sketch, in time it sort of develops itself. If you don’t start nothing gets done.

I am developing it on juust.org/serp/, once its finished i’ll put one on trismegistos.net and put the source up for download.

It’s flimsy but the idea of a serp minisite with emailer option is commercially attractive.

It’s also important for the blog to have a ’serp’ page in the menu, and a serp page should have serp tools, in abundance, all kinds of them.

]]> http://www.juust.org/index.php/serp-tool-2008/2008/09/feed/ 0 serp pagerank php seo tool http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/ http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/#comments Wed, 09 Jul 2008 01:23:02 +0000 juust http://www.juust.org/?p=33 So how did I do with a few days search engine optimisation ? not bad at all, on php+serp nicely on second spot behind shoemoney.com and on serp+php also front page, and on the 5 keys overall 13th. not bad for a PR0 domain.

5-key serp : serp pagerank php seo tool

count hits domain
7.8 8 www.juust.org
16 serp pagerank http://www.juust.org/ 0.2
8 serp php http://www.juust.org/ 1
9 serp php http://www.juust.org/index.php/php-serp-scripts/2008/07/ 1
99 serp tool http://www.juust.org/ 0.2
42 pagerank serp http://www.juust.org/ 0.2
3 php serp http://www.juust.org/ 3
4 php serp http://www.juust.org/index.php/php-serp-scripts/2008/07/ 2
70 seo serp http://www.juust.org/ 0.2

and who are the competition :

points results domain
20.2 13 www.seochat.com
16.6 21 www.seocompany.ca
15.6 13 sitening.com
14.6 10 www.webconfs.com
13.4 21 forums.digitalpoint.com
11.4 11 www.prchecker.info
11 4 en.wikipedia.org
10 19 www.webmasterworld.com
9 4 www.cristiandarie.ro
8.8 8 www.seroundtable.com
8.4 5 www.shoemoney.com
8.4 5 www.google.com
7.8 8 www.juust.org
7.6 6 tools.seobook.com
7.2 9 www.jumptags.com
7.2 14 www.seomoz.org
7 7 www.seoserp.com
6.4 14 forums.seochat.com
6.4 10 link.ezer.com
6.4 4 www.ljfind.com
5.8 7 www.iwebtool.com

Now, for the seo+tool niche… an online trackback spider…

]]> http://www.juust.org/index.php/serp-pagerank-php-seo-tool/2008/07/feed/ 0 php serp scripts http://www.juust.org/index.php/php-serp-scripts/2008/07/ http://www.juust.org/index.php/php-serp-scripts/2008/07/#comments Mon, 07 Jul 2008 12:51:19 +0000 juust http://www.juust.org/?p=28 Some basic PHP search engine result page scripts (always come in handy for yer basic seo adventures).

MSN Serp

  1. $first=1;
  2. $query="php+serp";
  3. $count=50;
  4.  
  5. $xml = @simplexml_load_file("http://search.live.com/results.aspx?q=$query&count=$count&first=$first&format=rss");
  6. foreach($xml->channel->item as $i) echo $i->link."<br />";

www.tellinya.com has another version for non-simplexml servers (uses curl and the ehttp.client class, the technique is closer to a sequential line parser so sometimes its more practical (hint:blog-pipe parsing with “streams”).

Yahoo Serp

  1.  
  2.         $varkeywords=$_GET["keywords"];
  3.         $vardomain=$_GET["domain"];
  4.        
  5.  
  6.         $strResult='';
  7.         $strHitsResult='';
  8.         $strHitsCount=0;
  9.         $strHits='';
  10.  
  11.         $start = 1;
  12.         $numberofresults = 10;
  13.         for($ii=0; $ii&lt;20; $ii++) {
  14.             $jj=$ii*$numberofresults+1;
  15.             $kk=$jj+$numberofresults;
  16.  
  17.         $vargoogleresultpage = "http://search.yahoo.com/search?p=".urlencode(trim($varkeywords))."&ei=UTF-8&fr=sfp&xargs=0&pstart=1&b=".$jj;
  18.             flush();  
  19.            
  20.             $googleresponse = join("",file($vargoogleresultpage));
  21.         $googlehits = preg_split('/<a class=\”yschttl\” /', $googleresponse, -1, PREG_SPLIT_OFFSET_CAPTURE);
  22.             foreach($googlehits as $googlehit){
  23.             $i++;
  24.             preg_match("/href=\"(.*?)\"/", $googlehit[0], $t, PREG_OFFSET_CAPTURE);
  25.                
  26.                
  27.             if($i > 1){
  28.                 $serp = $i-1;
  29.                 $SearchForDomain = "~".$vardomain."~i";
  30.                     if(preg_match($SearchForDomain, $t[1][0])){
  31.                     $strHitsCount++;
  32.                     $strHits .= $serp .', ';    
  33.                     $strResult=$strResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  34.                     $strHitsResult = $strHitsResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  35.                             } else {
  36.                                     $strResult=$strResult.$serp."</a><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a><br />";
  37.                                     }
  38.                         }
  39.            }
  40.         }
  41.         echo $strHits.' total = '.$strHitsCount.' <br />';
  42.         echo $strHitsResult;
  43.         echo '<br /><br />full list :<br />';
  44.  
  45.         echo $strResult;

Google SERP

  1.         $varkeywords=$_GET["keywords"];
  2.         $vardomain=$_GET["domain"];
  3.        
  4.  
  5.         $strResult='';
  6.         $strHitsResult='';
  7.         $strHitsCount=0;
  8.         $strHits='';
  9.  
  10.         $start = 1;
  11.         $numberofresults = 100;
  12.         for($ii=0; $ii&lt;11; $ii++) {
  13.             $jj=$ii*100+1;
  14.             $vargoogleresultpage = "http://www.google.com/search?as_q=".urlencode(trim($varkeywords))."&num=".$numberofresults."&start=".$jj."&hl=en&lr=lang_en";
  15.             flush();
  16.            
  17.             $googleresponse = join("",file($vargoogleresultpage));
  18.         $googlehits = preg_split('/class=r><a /', $googleresponse, -1, PREG_SPLIT_OFFSET_CAPTURE);
  19.             foreach($googlehits as $googlehit){
  20.                 $i++;
  21.                 preg_match("/href=\"(.*?)\"/", $googlehit[0], $t, PREG_OFFSET_CAPTURE);
  22.                
  23.                
  24.                 if($i > 1){
  25.                         $serp = $i-1;
  26.                         $SearchForDomain = "~".$vardomain."~i";
  27.                         if(preg_match($SearchForDomain, $t[1][0])){
  28.                             $strHitsCount++;
  29.                             $strHits .= $serp .', ';    
  30.                             $strResult=$strResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  31.                             $strHitsResult = $strHitsResult.$serp."<b><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a></b><br />";
  32.                             } else {
  33.                                     $strResult=$strResult.$serp."</a><a href=\"".$t[1][0]."\" target=\"_blank\">".$t[1][0]."</a><br />";
  34.                                     }
  35.                         }
  36.            }
  37.         }
  38.         echo $strHits.' total = '.$strHitsCount.' <br />';
  39.         echo $strHitsResult;
  40.         echo '<br /><br />full list :<br />';
  41.  
  42.         echo $strResult;

MSN (being microsoft) don’t encourage commercial use of the rss-feed.

]]> http://www.juust.org/index.php/php-serp-scripts/2008/07/feed/ 1 seo : pagerank and serp part I http://www.juust.org/index.php/seo-pagerank-and-serp-part-one/2008/07/ http://www.juust.org/index.php/seo-pagerank-and-serp-part-one/2008/07/#comments Thu, 03 Jul 2008 15:56:41 +0000 juust http://www.juust.org/?p=13 Today I go do something dumb, as usual ! I still had to finish my serp tool, and as I was checking out a site’s performance I really needed it, so I added a permutation routine and a mysql backend to the serp tool and tied it to a domain info class.

The serp is a three keys set with permutations,

  • single  1, 2, 3
  • double 12, 23, 13, 32, 21, 32
  • triple     123, 132, 213, 231, 312, 321

15 searches, my chosen keys are php, serp, pagerank, I get a full spread. 1500 results and  +/- 680 different hosts.

then i go do my old magic trick,

count the results, spot 1-3 = 3 points, spot 4-6 = 2 points and spot 7-10 = 1 point. The rest are 0.2 points so all domains get a count of the number of results and a sum for the points they score.

Then I know who are ‘top dog’ in my :) search engine result page.

Forums and communities have a broader spread (phpclasses, seomoz), more pages with content and more titles so they are bound to score on about every permutation and usually have a big pagerank (5 to 8), but what they gain in size they loose in strength and speed.

lets check the result set :

domain results points pagerank pages backlinks dmoz
www.siteometrics.com 16 32.8 2 37 244
seolutions.net 16 26.8 3 43 986
forums.digitalpoint.com 20 13.2 7 4354858 147000 1
www.selfseo.com 13 12 3 884 17500
www.toptenserp.com 9 8.6 2 196 763
www.seroundtable.com 9 8.2 4 15053 203000
www.prchecker.info 8 6.8 8 323 1460000
www.seochat.com 10 6.6 4 12972 558000
www.webmasterworld.com 24 6.4 7 230611 182000
marketingfeeds.nl 2 6 4 37237 6210
www.getfreesofts.com 13 5.4 4 275521 34900
www.shoemoney.com 3 5.2 6 12774 105000
video.aol.com 3 5.2 8 14073952 3300000 1
www.rankwhere.com 3 5.2 4 228 919
www.ljfind.com 3 5.2 3 1771559 1800
forum.siteground.com 9 5 7 30050 4570
www.phpclasses.org 6 4.8 6 150356 88100
www.hotscripts.com 6 4.8 7 219323 461000
hosthideout.com 7 4.6 5 161532 2150 1
www.top25web.com 4 4.4 3 143 15900
juustout.gethost.nl 8 4 0 173 184
www.webmasterforums.com 9 3.6 3 50550 45300
sitening.com 8 3.4 6 2714 29700 1
www.phplivesupport.com 3 3.4 7 1463 120000
www.webworkshop.net 4 3.4 5 119233 15100
www.google-pagerank.net 4 3.4 5 318 20200
www.database-search.com 3 3.4 3 14077 195000
en.wikipedia.org 2 3.2 9 208719522 56700000 1
www.nap.edu 3 3.2 9 2458 227000
www.php.net 1 3 9 170567 15700000
www.webopedia.com 1 3 5 35722 2170000
www.cs.und.edu 2 3 6 195 409
www.investopedia.com 1 3 4 19828 191000
www.smartpagerank.com 6 2.8 3 12051 25400
www.phpbits.info 5 2.6 2 22 2940
www.programsdb.com 13 2.6 4 236295 37700
www.serp-chem.eu 4 2.4 6 18 11400
www.pagerankcode.com 4 2.4 2 6 211
www.searchenginepanel.com 12 2.4 3 84 2590
www.devpapers.com 3 2.4 5 2196 152000
www.googlecommunity.com 2 2.2 5 251463 4150
www.webmasters.am 11 2.2 5 15587 3330
www.sitepoint.com 11 2.2 7 2134801 371000
link.ezer.com 2 2.2 4 2094 3180
forums.searchenginewatch.com 11 2.2 7 86027 142000 1
livepr.raketforskning.com 2 2.2 3 105136 122000
searchengineland.com 10 2 7 41187 442000 1
www.talkdigger.com 1 2 6 743479 145000

…which supports the idea that you don’t need massive backlink counts and even pagerank-0 (my other site (gloat)) is not any hindrance. Pagerank distribution in small sites is easier to manage so a few backlinks will do.

Next edition : seo : pagerank and serp : part II I pick a few small sites of the list and spider them, assert their link structure, retrieve the backlinks and spider the linking pages to see what links point directly to which urls, and make a “push-and-juice” analysis of the actual strength of these pages. Then I go relate that to the place on the search engne result page and estimate what is needed for a top-10 spot.

enough nonsense for today, here is a commercial message from Aunty Google :

]]> http://www.juust.org/index.php/seo-pagerank-and-serp-part-one/2008/07/feed/ 0