and make BIG DATA available quickly and efficiently. Through our experience in web crawling and online BIG DATA Analytics:
We generate personalized BIG DATA and web crawling solutions especially for your individual requirements. We extract the requested data from the Internet using efficient web spiders, structure it and, after data cleansing, we merge it with other online data sources if requested.
Based on this database, your sales, management or product management receives crucial information about your competition and potential customers in order to generate additional growth.
Lot Internet GmbH was founded in 2011 by business analysts, crawling specialists and IT experts with many years of professional experience. We are an international team based in Potsdam, Germany. Our focus is on data extraction through crawling, data cleansing and enrichment, as well as data analysis.
Our B2B customers are well-known online marketplaces in the real-estate, automotive, career, e-commerce and telecommunication sectors, which use our data for market research, competition monitoring and customer analysis.
Our MISSION
Utilization of BIG DATA
INITIAL SITUATION
Relevant data about dealers, advertisements, product information, market prices, existing and potential customers, and competitors are freely available on the internet
CHALLENGE
The automated utililzation of online information is demanding due to the large amount of data, heterogeneous information structures and different web data sources
APPROACH
After the extraction / crawling of online data, data cleaning and enrichment and the linkage with
other data sources it is possible to use comprehensive information from the internet in a
structured way.
IMPLEMENTATION
- daily collection, crawling and updating of all online data
- data cleansing of all files
- transformation into the requested table and data format
- automated and quality-assured data export
OUR SERVICE
Success with BIG DATA and Web Crawling
Lot Internet GmbH is an integrated service provider in the area of Web Data Analysis, Crawling
and Big Data. We serve the entire analytical value chain, from the extraction of raw data from
any online data sources, data cleaning and enrichment to data export in the requested format or
the supply of individual reports and dynamic dashboards. In this way, we offer our customers
outstanding transparency about market events, customer needs, competitors, product- and
service prices as well as customer potentials. Let us convince you of our services as part of a
free proof of concept. We deliver the requested information up-to-date and reliably.
Web Data Search
Definition of online forums, websites, portals and social networks with relevant content
Data Collection
High-performance and up-to-date data extraction / crawling from any online source
Data Cleansing & Data Maintenance
Data comparison with reference sources to correct and supplement the raw data
Data Storage
Data storage in the company’s own highly scalable data warehouse
Data Export
Data export of optimized and quality-assured web data in any format requested by the customer
Data Quality Monitoring
Continuous monitoring of the crawled raw data including alerts in case of any deviations from
the desired data quality targets.
Reporting and Analysis
Development of individual reports and dynamic dashboards according to customer
requirements, which can be made available via web browser
Data - Visualization
Analysis and visualization of the extracted data to identify trends, dependencies and patterns
Data Collection
Daily collection and storage of all used car ads and dealer information in Europe
Data Cleansing
Cleaning of address data by referencing commercial registers available online and
standardization of car ads according to international model codes
Data Enrichment
Linkage of dealer information with other online data sources to enrich company size, year of foundation, number of employees, etc.
Data Matching
Matching the dealer and ads data between different data sources to identify same ads and
dealers
Data Quality Assurance
Continuous monitoring of data quality, e.g. by checking the fill rate of ad fields or the plausibility of ad contents
Data Storage
Storage of provider and advertisement data in the company's own data warehouse
Data Export
Daily data export to the customer’s data warehouse in any requested data format
Data Analysis
Depending on our customer requirements, individual reports or dynamic dashboards are
developed, which can be made available online
Contact