Pioneer Natural Resources Company is an independent oil and gas exploration and production company. The Company engages in onshore oil and gas drilling, exploration, and production in the United States. Its 11,000-plus gross producing wells mine about 85 million barrels of oil each year.
Pioneer was using several vendors for its IOT data analytics. In spite of using several vendors they were still challenged with integrating data between these vendor data silos. And data was not in a uniform consistent format. An in-house solution was necessary to avoid paying vendors and also to bring data in-house for data exploration, advanced deep analytics that helps business improve operations and save costs.
iOLAP helped Pioneer architect, build & develop a Hadoop platform (Cloudera) for storing and processing data. Data was processed in real-time and as well as in batches. IOT sensor data was processed in real-time using Cloudera, StreamSets, Spark, Impala, Hive technologies. SpotFire was used for reporting. Microsoft Azure was used as IAAS cloud platform. DataStax Enterprise (Cassandra) was used for real-time analytics/model scoring, while Hadoop was used for batch processing and model training. Data Lake was built to support cross-platform analytics between data from data warehouses, IOT sensors & historians.
The new Hadoop platform enabled Pioneer to integrate all its structured, unstructured & semi-structured data in one place (data lake). By bringing IOT sensor data in-house, Pioneer was able to run critical models to predict equipment failures, improve well operations resulting in significant cost saving. Users were able to seamlessly query both real-time and batch data using various tools and get data in consistent format.