Page 1 of 2
Enhancement for AJAX sites via google loophole
Posted: Fri Feb 11, 2011 3:10 am
by alexbobp
Google has published a specification for allowing ajax sites to load content on a single page through javascript, but still be crawlable. Basically there is a rewrite rule you can apply to fragment links to get an actual http link to the content.
https://code.google.com/web/ajaxcrawlin ... arted.html
Lots of sites (twitter for example) seem to be supporting this. If noscript adds this feature, it could let us browse such sites with javascript turned off.
Re: Enhancement for AJAX sites via google loophole
Posted: Fri Feb 11, 2011 9:04 am
by Giorgio Maone
Very interesting, thank you.
Re: Enhancement for AJAX sites via google loophole
Posted: Wed Feb 16, 2011 3:03 pm
by Giorgio Maone
Re: Enhancement for AJAX sites via google loophole
Posted: Wed Feb 16, 2011 6:31 pm
by dhouwn
Apparently not working with the current 4.0 beta:
Code: Select all
[NoScript XSS] xss.reason.ReferenceError: qs is not defined --- ([object XPCWrappedNative_NoHelper],"http-on-modify-request",null)@chrome://noscript/content/RequestWatchdog.js:84
loadURIWithFlags("http://lifehacker.com/#!5465246/mozilla-warns-of-two-firefox-extensions-containing-trojan-malware",0,[object XPCWrappedNative_NoHelper],"UTF-8",(void 0))@chrome://global/content/bindings/browser.xml:193
addTab("http://lifehacker.com/#!5465246/mozilla-warns-of-two-firefox-extensions-containing-trojan-malware",[object XPCWrappedNative_NoHelper])@chrome://browser/content/tabbrowser.xml:1326
loadOneTab("http://lifehacker.com/#!5465246/mozilla-warns-of-two-firefox-extensions-containing-trojan-malware",[object XPCWrappedNative_NoHelper])@chrome://browser/content/tabbrowser.xml:1093
openLinkIn("http://lifehacker.com/#!5465246/mozilla-warns-of-two-firefox-extensions-containing-trojan-malware","tab",[object Object])@chrome://browser/content/utilityOverlay.js:237
handleLinkClick([object MouseEvent],"http://lifehacker.com/#!5465246/mozilla-warns-of-two-firefox-extensions-containing-trojan-malware",[object Proxy])@chrome://browser/content/browser.js:10498
contentAreaClick([object MouseEvent],false)@chrome://browser/content/browser.js:10461
onclick([object MouseEvent])@chrome://browser/content/browser.xul:1
Re: Enhancement for AJAX sites via google loophole
Posted: Wed Feb 16, 2011 8:25 pm
by al_9x
dhouwn wrote:Apparently not working with the current 4.0 beta:
neither in 3.6.13
Re: Enhancement for AJAX sites via google loophole
Posted: Wed Feb 16, 2011 9:03 pm
by Giorgio Maone
Yep, there's a bug which slipped in 10 seconds before release and I'm fixing right now.
Re: Enhancement for AJAX sites via google loophole
Posted: Wed Feb 16, 2011 9:33 pm
by Giorgio Maone
Re: Enhancement for AJAX sites via google loophole
Posted: Thu Feb 17, 2011 3:57 pm
by alexbobp
Awesome. I'm glad you liked the idea, and I'm amazed you implemented it so fast.
Lifehacker article permalinks work, and that's pretty excellent. (The homepage is still broken though, I guess it uses javascript to populate it's frame)
Excellent work! I'll be pitching a few bucks towards your beer fund.
Re: Enhancement for AJAX sites via google loophole
Posted: Sun Feb 20, 2011 6:11 am
by al_9x
On this new style ajax site, the next post click fails when doubleclick.net is blocked. The quickest way to repro is on gawker.com.
Fx 3.6.13, NS 2.0.9.9rc2, new profile
- go to http://gawker.com/
- allow gawker.com, gawkerassets.com
- after refresh, the content should appear, click "NEXT POST" (bottom left corner)
- the ajax nav never fully completes, a couple of js errors are logged:
Code: Select all
Error: too much recursion
Source File: http://fastcache.gawkerassets.com/assets/base.v10/static/base.v10.jqueryplugin.20110217.js
Line: 6
Error: too much recursion
Source File: http://fastcache.gawkerassets.com/assets/base.v10/static/base.v10.jquery.20110217.js
Line: 16
- If you allow doubleclick.net at gawker.com, "NEXT POST" ajax nav completes
Re: Enhancement for AJAX sites via google loophole
Posted: Sun Feb 20, 2011 9:29 pm
by Giorgio Maone
It actually works for me. Maybe they already fixed it?
Re: Enhancement for AJAX sites via google loophole
Posted: Mon Feb 21, 2011 7:54 am
by al_9x
Giorgio Maone wrote:It actually works for me. Maybe they already fixed it?
No, still happening with 100% consistency on a new profile, the content loads, but remains covered by a semi-transparent overlay with a spinner.
Re: Enhancement for AJAX sites via google loophole
Posted: Mon Feb 21, 2011 11:42 am
by dhouwn
Can't reproduce, "NEXT POST" works fine, some exceptions like the following get logged though:
Code: Select all
Error: jQuery(".t_" + d.thread_id).html(d.content) is null
Source File: http://fastcache.gawkerassets.com/assets/base.v10/static/base.v10.widget.20110217.js
Line: 42
BTW, I have subdomain-matching turned on and just allowed
gawker.com and
fastcache.gawkerassets.com.
Re: Enhancement for AJAX sites via google loophole
Posted: Tue Feb 22, 2011 4:23 am
by al_9x
They changed their interface, there's no longer a next post button, but a list of posts. I can still repro by clicking on any post title. 2 "too much recursion" errors and it stays in this state:
To resolve, you have to allow doubleclick.net and also the script that doubleclick in turn loads 2mdn.net. It used to take just doubleclick. That you can't repro is an indication that there probably isn't a real dependency on doubleclick but something timing sensitive, can you perhaps try on your slower laptop?
Re: Enhancement for AJAX sites via google loophole
Posted: Tue Feb 22, 2011 6:09 am
by therube
2. allow gawker.com, gawkerassets.com
Then I allowed an Object. *@
http://gawker.com, I think it was.
After that, the links worked as expected.
After a Reset, a manual refresh may be needed.
Looks like sometimes a link will load fully, sometimes partially, sometimes opaque like your screenshot.
Also looks like they have an object which nukeanythingenhanced can zap to clear some "opaque" up.
(The double vertical scroll is totally weird.)
Re: Enhancement for AJAX sites via google loophole
Posted: Tue Feb 22, 2011 9:11 am
by al_9x
therube wrote:Looks like sometimes a link will load fully, sometimes partially, sometimes opaque like your screenshot.
Well, it looks like you can repro intermittently, for me it's consistent. When it's like in my screenshot, do you get the "too much recursion" errors in the console?