For the Big Data and Data Analytics segment of our series on the Most Interesting APIs added to ProgrammableWeb in 2018, we include APIs that enable developers to access, manipulate, and analyze data. This includes APIs for Data, Open Data, Data Visualizations, Database, SQL, Analytics, Data Mining, Extraction, Classification, Linked Data, Charts, and others. Listed below are the Data APIs added to our directory during 2018 that might peak interest of a data scientist, or a developer.
Google CloudInference API allows users to run large scale time series data analysis and gather insights in real time. The Inference API could be used to analyze foot traffic and conversion for retailers, detect data anomalies, identify correlations over sensor data, and many other uses. This API is integrated with other Google Cloud Storage services, but is currently in alpha release and might be changed.
Related: Google Announces Cloud Inference API
semanti.ca provides web article data powered by artificial intelligence. The semanti.ca API allows developers to extract the web article data most relevant to humans. The service can accurately recognize titles, headlines, published and updated dates, images, captions, and tags. It ignores advertisements, design elements, and any text or images not related to the main content.
This is semanti.ca's parsed results from a ProgrammableWeb article about the new ClashRoyale API. Image: semanti.ca
Vehicle Smart fulfills millions of Vehicle Registration Mark (VRM) requests for UK businesses every month. The Vehicle Smart API offers VRM lookup for Driver Vehicle and Licensing Agency (DVLA) and Driver and Vehicle Standards Agency (DVSA) data for all UK vehicles. This data enables developers to add tax and MOT data to applications and web services.
BMC Software's Truesight Intelligence platform is a Big Data IT analytics platform. The platform aims to help businesses maximize information technology operations and efficiency. The BMC TrueSight Intelligence API returns JSON data about the analytics' platform events, measurements, and metrics.
SQLify provides a tool to convert any data into querable data. SQLify API is available to enable third-party applications with the data conversion services. The API converts JSON data into query-able data (CSV or SQL). SQLify offers full API access for free. A paid plan is also available which offers unlimited row processing and chat support.
Jumpcloud provides Directory-as-a-Service solutions for IT admins to securely connect and manage users with the applications, devices, file servers, and networks users need to access. The JumpCloud API allows developers to access users' directories from Office 365, LDAP,G-Suite, and Active Directory, featuring methods for commands, policies, applications, systems, groups, and radius servers. The JumpCloud Events API allows admins to access events' data including JumpCloud account addition, deletions, and modifications.
Datakick is a product database with the mission to "Build a database of every product in the world that is free to everyone". Anyone can add and edit items in the Datakick product database. The Datakick REST API enables programmatic access to product UPC and/or EAN codes. UPC stands for universal product codes and EAN is European article number.
Dexi provides data extraction and data automation tools. Dexi's bots extract information from any website and support a full browser environment. Dexi Pipes' robots are powered by an ETL and data transformation engine which allow for diverse post processes by the user. Login is required for Dexi API access, and SDKs are offered in several languages.
How to use Dexi.io to extract data from websites with pagination. Video: Vimeo/Dexi.io
Skiverx is a web data scraping service. The Skivrex API allows users to extract parsed product data from Amazon, eBay, and other eCommerce platforms. Retrieve data via the default configuration or create your own configuration.
The US Consumer Financial Protection Bureau ensures that borrowers are treated fairly by banks, lenders, and other financial institutions. The Home Mortgage Disclosure Act (HMDA) API allows users to build tools for accessing the HMDA public data.
Programmatically access data from the Home Mortgage Disclosure Act with this API. Image: consumerfinance.gov
World Trading Data provides historical stock data as well as real time quote data. Developers can use the World Trading Data API to retrieve over 30 years of historical data and real time data for up to 200 stocks returned in under half a second. API methods are available to sort data by company, symbol, date, 52 week high or low, and much more.
Boggio Analytics provides services to build data applications focusing on data extraction and prediction. The Boggio Analytics Football Prediction API provides predictions for upcoming football matches, average bookie odds, results for past matches and performance monitoring for the statistical models.
DataSift provides technology for capturing, analyzing and using Human Data without compromising consumer trust. The DataSift Streaming API offers a high-throughput way to receive DataSift's curated data from social networks, blogs, and message boards. Developers can use the API to open a connection between a client and DataSift's streaming API, send one or more requests for data from a stream, and close the connection when done.
Receive, process, analyze a real-time feed of Human Data with the DataSift API. Image: DataSift
MarkerTrademark Search API returns JSON data with trademark serial numbers, descriptions, and registration dates. Developers can use the trademark search API to search the US trademarks database (USPTO) based on a search string.
Arcentry is an open source and cloud diagramming service. With the service, users can create diagrams, customize drawing items, draw with lines, arrows, areas, images & icons, and export high resolution diagram images for presentations, blog posts, social media, and developer platforms.The Arcentry API allows users to create, manipulate and delete objects on their Arcentry diagrams. The RESTful API provides a way to add metrics to an infrastructure, visualize scaling groups, show problems in context and more.
This diagram of Google Cloud architecture was made with Arcentry. Image: Arcentry
Companies House is an executive agency sponsored by the Department for Business, Energy & Industrial Strategy in the United Kingdom that provides free company and executive officer information. The Companies House API enables applications to search and retrieve company data about companies registered in the UK. Retrieve data including company names, addresses, officers, insolvency, disqualifications statements, and more for about 3 million companies.
The Launch BIAPI provides a common API to various enterprise BI platforms, using web standards. BI platforms include Tableau, Cognos, SAP Business Objects plus API Management tools such as Cloud Elements, Mulesoft, as well as mobile, desktop apps and data mining tools.
Here's the Launch BI Embedded Analytics API overview. Video: YouTube/LaunchWorks