Success Story
Petrochemical Company · Background
The petroleum industry is a knowledge and technology-intensive industry that integrates multiple disciplines and specialties, with upstream enterprises' main businesses involving oil and gas exploration, oilfield development, drilling engineering, well operations, surface construction, material management, business management, water and electricity, communications, healthcare, and more. Information technology in the petroleum industry has consistently accompanied the development of petroleum enterprises and played a significant role.
Petroleum industry data has several notable characteristics: highly dispersed data distribution, massive data volume, complex data structures, high data utilization value, multiple storage media with complex formats, and complex software usage environments. Based on these challenges, there is a need to build a data center platform to connect data sources and application layers. This involves aggregating business data, establishing data warehouses through standardized data governance, promoting data standardization and assetization; building comprehensive, standardized data assets; providing data services for various business scenarios; and offering data decision support for senior management.
Project Objectives
- 01
Digital Modernization of Legacy Systems
According to the overall digital development strategy, based on the current EPBW framework and future business and scenario requirements, establish a data middle platform covering the entire data lifecycle using leading technologies such as cloud computing and big data.
- 02
Data-Driven Business Empowerment
Improve data sharing and exchange efficiency, further activate data asset value, empower refined operations, and drive innovation in data applications and business models.
- 03
Offer End-to-End Data Capabilities Building
Promote data standardization, assetization, service-oriented approach, and value creation, ultimately achieving comprehensive data aggregation, governance, management, and service capabilities.
Solution Architecture
Implementation Results
Architecture System Upgrade
Compared to the existing EPBW architecture system, the KeenData middle platform architecture system shows significant improvements in data storage, cost, performance, data security, scalability, data sharing service capabilities, and maintainability.
Holistic Data Asset Accumulation
Complete asset catalog and related metadata design and configuration in the exploration institute's data middle platform according to the business domain and theme division method in the EPBP metadata database.
Build End-to-End Data Development System
Support 5 headquarters business systems, and achieve daily full data aggregation and synchronization from 12 oilfield EPBP system source business tables to the data middle platform; support comprehensive data visualization query and physical table search in the data middle platform, and support business database queries; follow data middle platform implementation methodology to support warehouse model design implementation, including data theme, unified indicators, logical models, and physical model creation; build end-to-end monitoring system to visually monitor all task execution and quickly locate production issues.
Build Data Service System
Provide capability to quickly generate APIs from data tables, support rapid registration of existing APIs, achieve unified API publishing and authorization management; data service authentication uses Token, AKSK and other methods to ensure security and reliability; provide multi-dimensional API real-time operation monitoring function, support monitoring API operation status of different applications; provide interface-based configuration method to generate APIs, provide SQL mode for advanced users to generate APIs, support multi-table association, complex queries and aggregation functions.
Related Products
Keen DaaS Data Service Platform
Data service publishing center, seamlessly connecting with business production systems, solving the last-mile data usage problem. Supports quick service API creation through SQL and drag-and-drop methods, providing complete API lifecycle management, including creation, maintenance, publishing, operation, monitoring, and decommissioning.
View Details
Keen Stream Real-time Computing Platform
Provides a fully visual, easy-to-use, high-throughput, one-stop streaming data computing and processing platform, supporting real-time data cleaning, analysis, and synchronization through SQL, with comprehensive monitoring mechanisms ensuring accuracy of stream computing. Can support enterprise real-time data warehouse construction, real-time data dashboards, real-time reporting, and other enterprise real-time data processing scenarios.
View Details
Keen BDP Data Development Management Platform
Provides comprehensive managed workflow services and one-stop development management functions, empowering enterprises to build and manage big data capabilities across the entire chain, achieving comprehensive data asset management and establishing private big data centers.
View Details
Keen Asset Data Asset Catalog
Enterprise's unified data asset portal, serving as a map of enterprise data assets, can provide data information queries for various enterprise roles, trace data origins and specific processing calculation logic. Data assets are automatically accumulated during data development and construction, requiring no manual maintenance.
View Details
Keen Dsync Data Synchronization System
One-stop data synchronization product for enterprise multi-source data integration. Solves data interaction and synchronization problems between complex heterogeneous data sources such as relational databases, non-relational databases, big data platforms, and file systems within enterprises under high-concurrency big data scenarios, achieving unified data sharing and distribution within enterprises.
View Details