search-close-icon

Search here

Can't find what you are looking for?

Feel free to get in touch with us for more information about our products and services.

Sychronizing data extracted with Grepsr

One of Grepsr’s most powerful feature is the ability to synchronize data in a variety of different ways when a new data is available. The whole idea behind this feature is to automate our data delivery process. It would really be tedious if you have to login to your grepsr account everyday to check if there is new data. If you are comfortable doing that, no problem 🙂 but as a user we’d rather have it sync automatically.

I’ve already touched base on FTP and Dropbox in my earlier post. I’ll try to explain all our sync options and how you could use them in a real world scenario.

There are currently 5 data sync options. They are:

  • Call Back URL
  • DropBox
  • Email
  • FTP
  • Google Docs

Scenario #1: You run a shopping website and you need prices compared with your competitors once every day – Callback URL

You would want to use, Call Back URL option for this. Grepsr would post the latest data to your system via HTTP POST. You need to configure your callback URL, typically something like (http://www.yourdomain.com/callback.php) to read data posted to it. Your callback script would then import this data in your database (mySQL, MongoDB, MS SQL etc) and perform whatever operations you need to perform on the data. Perhaps match the product SKU with your own database and reduce your product’s price by 1% to stay competitive? Its your call!

Call Back URLs are ideal when there are a lot of data.

Scenario #2: You are a news reporter and you need latest news from various sources once you wakeup every morning – DropBox or Email or Google Docs

So you are not a technical guy, but use DropBox to stay in sync with your files? Thats all that you need. You can have us gather news data from various sources once every day or less. Then just attach your DropBox account with our service and that is all! Grepsr will send you the news as Spreadsheets. You can then process the news and re-write them or blog them! We even deliver the news as PDFs if that helps.

If you need to use Email, thats fine too. Grepsr will send you the same files in the emails which you can download to view. The files are securely hosted in our cloud, so you need not worry about data security.

If you are a big fan (who isnt?) and heavy user of Google Docs, you can have Grepsr automatically sync the latest data to your Google Docs account, so that the data is in one place. This method is ideal only when the volume of data is less than 5000 records, because Google Docs has its restrictions.

Scenario #3: You are a business owner, and you need to extract heavy amount of data and archive them for processing – FTP

FTP would be the right deal for this case. Grepsr can send all the data that was extracted  directly to your FTP server, neatly organized in folders. You can then choose to process them either manually or using your in-house technologies. This method is ideal because it helps you keep archived data for future reference.

Some of our monthly customers have the habit of doing things manual. We just want to ask you to make full use of all these wonderful sync options we have in place! If you need help, you could always buzz us – we are ever ready to offer tips and advice on any of our features!

BLOG

A collection of articles, announcements and updates from Grepsr

Unleash-the-power-of-cyber-monday

E-commerce in Overdrive: Unleash the Power of Cyber Monday 

In 2022, Cyber Monday accomplished a remarkable feat, propelling e-commerce sales to an impressive $11.3 billion—an extraordinary 5.8% increase, setting a new benchmark for online shopping. As the holiday season approaches, the global culture of bestowing gifts and celebration is also at an all-time high. For these times to be extra special, people look for […]

amazon scraping challenges

Common Challenges During Amazon Data Collection

Over the last twenty years, Amazon has established itself as the world’s largest ecommerce platform having started out as a humble online bookstore. With its presence and influence increasing in more countries, there’s huge demands for its inventory data from various industry verticals. Almost all of the time, this data is acquired via web scraping […]

Our Newly Redesigned Website is Live!

We’ve redesigned our website to make it easier for you to find what you’re looking for

Preview the New Look Grepsr App

Everybody’s favorite big data tool is getting a fresh coat of paint (and some behind-the-scenes tweaks)

Introducing Grepsr’s New Slack-like Support

Making our data acquisition specialists more accessible to busy professionals

Getting an Unstructured Data Error Message? Here’s Why

When you tag data fields using our web scraping browser extension, you may get an error message sometimes that says “The data is unstructured. Please try again.” at the bottom-right corner of the screen. Cause The main reason this happens is that the selected fields are located in different containers within the website’s HTML code. This […]

Data Delivery via Dropbox

Have your Grepsr files synced automatically to your Dropbox

Data Delivery via FTP

Have your Grepsr files synced automatically to your FTP/SFTP server

A New Look to the Grepsr App

If you’re a regular Grepsr app user, you may have noticed a slightly modified navigation bar with some new icons at the top of the Grepsr data extraction platform. Previously, all projects would be listed in one place. Now, to make things simpler and more streamlined, we’ve separated the app into two parts based on […]

How to Use Grepsr Browser Tool to Scrape the Web for Free

A beginner’s guide to your favorite DIY web scraping tool Just over a year ago, we introduced the all new Grepsr along with a beta launch of Chrome extension to fill the gap that Kimono Labs, a widely popular scraping tool, left since it’s closure. Now after a year of iteration on both the UI and UX along with shipping […]

Introducing the All New Grepsr

Chrome Extension, APIs, Better Support & Much More

Importance of Web Scraping in the Age of Big Data

Big Data has become an internet buzz lately. Not a day goes by without a mention of Big Data in many articles published by media or tech companies around the world.

arrow-up-icon