Comments on: Building a Datafeed Site – Step 3

By: Eric Nagel

Eric Nagel — Wed, 16 Nov 2011 19:46:46 +0000

That forces the site to go to www.

If your datafeed site is in a folder, you’d change the RewriteRules at the end. Instead of ^browse (starts with browse) you’d have ^folder\/browse

Eric

By: pbtasse

pbtasse — Tue, 15 Nov 2011 15:25:36 +0000

The 3th and the 4th line: can you explain a bit?
If the website is under another folder (not in the root) does this need some change?
Thanks again!
I love Datafeed. It is easy to build website with.

By: pbtasse

pbtasse — Tue, 15 Nov 2011 15:15:02 +0000

Can we use a bit of random products per page to make things unique. If this way is good, it will be easy to do it

By: Eric Nagel

Eric Nagel — Tue, 15 Nov 2011 15:12:58 +0000

Sure:

RewriteEngine On
RewriteCond %{HTTP_HOST} ^greenwhiteandblacktea.com [NC]
RewriteRule ^(.*)$ http://www.greenwhiteandblacktea.com/$1 [L,R=301]

RewriteRule ^browse\-(.*).php$ browse.php?cCategory=$1 [L]
RewriteRule ^(.*)\-p([0-9]+).php$ item.php?ProductID=$2&cName=$1 [L]
RewriteRule ^images/(.*)\-i([0-9]+).jpg$ images/image.php?ProductID=$2 [L]

By: pbtasse

pbtasse — Tue, 15 Nov 2011 15:02:41 +0000

Good design for the website: http://www.greenwhiteandblacktea.com/browse-black-tea.php
Please can you share with us the mod rewrite for this website.
There is no .htaccess in the files I download in this tutorial
Thanks

By: Eric Nagel

Eric Nagel — Mon, 14 Nov 2011 21:07:11 +0000

After that, it’s all custom coding. Either add a field for unique description, or build a blog to go along side of the product feed. There’s no one solution that fits everyone

By: pankaj

pankaj — Mon, 14 Nov 2011 20:44:56 +0000

Great tutorial. But i have a question, how to add content to these sites. At this moment , the site has pulled in all the datafeeds and displaying links to merchant- more info and buy now. But i want to add unique content on them or even edit some of the import content
– to avoid duplicate penalty and to give more boost in SER by writing content and avoiding the latest Panda slap of thin quality content. Is there a way out to do it?

Do we have to manually go to each import post and then edit them manually ?

also do we have the option of importing specific products rather then whole stream. Say i would like to work with only 30 products rather then 100.

By: Eric Nagel

Eric Nagel — Sun, 27 Feb 2011 15:23:07 +0000

Hi Max,

I ran into that problem years ago. For the bigger merchants, you need to break things apart. Either break off a merchant, or do it by network.

Proper indexing of the table helps, too.

By: Max M

Max M — Tue, 22 Feb 2011 03:13:39 +0000

Hey eric. Great post. I am currently in the process of implementing datafeeds for CJ, GAN, ShareASale, Linkshare, and PepperJam. I have already coded they scripts to automatically download and insert the datafeeds into the table. The problem I am facing now is the sheer size of the table. The script I wrote hasnt finished inserting CJ products yet and I am already up to 3.5 million records – about 2.8GB! The part I would like your advise on is how to handle the sheer size of the table. Should I create a new table for each network? Create partitions? Would indexing suffice? Currently a query takes about 6 seconds. Would appreciate any ideas.

By: LinkShare Merchandiser Web Service

LinkShare Merchandiser Web Service — Mon, 25 Oct 2010 12:20:00 +0000

[...] to the 3rd step in my Building a Datafeed Site series for an explanation of the ImgError JavaScript [...]