Frequently asked questions

In order to pull data, we need to set up crawlers no differently than how we would in a full-fledged project.Because of the time and effort this entails, we only take on a project once payment is received.

That said, for every project, we provide a sample dataset before moving on to full production. This ensures data is per scope and quality criteria are met. If you’re not satisfied with the sample, then we are happy to make modifications or even offer a full refund.

Absolutely! You can run manually crawlers on an ad-hoc basis or create recurring schedules to automate your crawl runs. Scheduled runs work like clockwork simplifying your data acquisition workflow.

Read more about scheduling crawlers in our platform documentation here.

For large scale data collection, we automatically deliver the output to your preferred cloud storage location. We support Amazon S3, Google Cloud, Azure Cloud, Dropbox, Box, FTP and more. You must authorize the respective filesystem before we can store the output.

Output can also be manually exported from the platform. Learn more about how you can integrate with Grepsr in our platform documentation here.

Absolutely! You can run crawlers manually on an ad hoc basis or create recurring schedules according to your requirements. Scheduled runs work like clockwork, simplifying your data acquisition workflow.

We support standard formats such as CSV, XLSX, JSON, XML, and YAML. Contact us if you need a custom format not supported out of the box.

Yes! Grepsr’s data management platform makes it easy for remote teams to collaborate on their data projects. You can also manage the access levels of your colleagues, so you always have control over who has visibility and into what.

It depends on the individual sites. Even though the site may look similar in structure, cases may require a different setup as they might use a different system internally. We can only confirm once we have the list.

Yes, we can extract text and tabular data and export it as Excel or any other required relevant file format (CSV, JSON, Excel, XML).

Yes, the system can handle PDFs and DOCs. However, if the PDFs or DOCs do not have a similar structure across the board, this can become more challenging. The layout or structure also affects how PDFs are extracted.

Scraping publicly available data is perfectly legal so long 1) it does not violate the source site’s terms of service, 2) data is not copyrighted, and 3) data does not contain Personally Identifiable Information (or PII). Fair to say, this is a contested and misunderstood topic. You can read more about the legalities of web scraping in our blog here.

Our governance and compliance function is structured to align with ISO 27001 standards, ensuring robust information security management across all aspects of our operations. We maintain and implement comprehensive policies for our Information Security Management System (ISMS), covering areas such as data collection, storage, and distribution. These policies include strict protocols for secure storage, access control, regular audits, and compliance with relevant legal and regulatory requirements. By adhering to ISO 27001 standards and maintaining a rigorous ISMS framework, we uphold the highest standards of data security and privacy throughout our operations.

The data is collected exclusively from public sources. These sources include publicly accessible websites where the data is freely available to the public without any access restrictions or requirements for special permissions. We do not claim ownership of the dataset, as it is sourced from publicly available information. Our role is limited to aggregating and organizing the data for easier access and analysis.

Customers with recurring data needs are priced monthly in arrears. There is an initial one-time setup fee. Customers are either billed a flat monthly fee or based on metered usage. The latter is reserved for high-volume projects. Other billable consulting and technical support fees are agreed in advance before they’re added to your invoice.

USP
Managed Service & Platform Based: Fully managed plug-and-play service. Customers need not worry about setting up crawlers or working around technical hurdles.

Fast & Reliable Services: Efficient delivery SOP with a quick turnaround time. Highly responsive support team to monitor and manage your data pipelines.

Advanced Quality Monitoring: Scalable quality control processes using both technology & dedicated reviewers to ensure the highest data quality consistently.

Flexible Pricing: A pricing model that works for you. Tailored pricing depends on your data requirements, volume, and use case complexity, so you pay based on your needs.

We provide bespoke data solutions, i.e., the customer (you) can define any data structure you want pulled from any target sites. Our experienced data acquisition team will set up the scrapes for you and deliver the data in the required format. In addition to the data we collect, we will also help you QA, dedupe, and normalize it when needed.

We assign customers to a dedicated Customer Success team member. They will be your main point of contact for any support, liaison with you during the setup, and ongoing support. As long as you’re a recurring member of our team, we will adjust the scrapes for any changes on the site for free.

We believe in growing with our partners; we have started with an initial set of requirements with our clients and have grown as their needs have grown. The partnership’s success lies in clearly setting expectations on timing, delivery, and cost estimates and continuing with very transparent pricing options for our customers and quality data.

Depending on the complexity of the fix, minor fixes will take one business day, and major fixes will take two to three business days. We also have a support and collaboration channel that you can use on our platform if there are any problems with the data.

Grepsr employs web scraping to extract data from websites. We provide Data-as-a-Service, wherein we will set up the bots/scrapers for you and run them on our cloud infrastructure. You can access the Grepsr platform to send requirements, view data, schedule extractions, set up data delivery, and communicate with our team. This platform is hosted on the cloud and accessed through the web.

No, we do not outsource data collection and distribution of the dataset. We have a dedicated team of engineers who write the specific crawler meeting your requirements, and these crawlers run on our cloud-based platform.

There is no limit to how much data you can collect. Data projects are priced based on scale and complexity.

To put an exact timeframe on our lead time, it strictly depends on the data requirements, such as the number of sources and complexity. Our customers value us for quick turnaround; on average, a typical project is completed in days, not weeks.
We set clear timeline expectations beforehand and aim to get the initial sample ready within a couple of days.

Yes! Our web crawlers can scrape images in the form of either URLs or files. Scraping as files requires extra effort and, as a result, will incur an additional charge. The image files will be zipped and emailed/synced with the rest of your data.