Offline Development Platform

It offers fully managed workflow services and one-stop development management functions, empowering enterprises to build and manage big data capabilities across the entire link, enabling comprehensive data asset management across domains, and establishing private big data centers.

Product Features Function Overview Application Scenarios

Product Features

Rich Data Processing Components

It provides a wealth of data processing components, enabling the entire process of data from ingestion to processing, and meeting the data development needs of complex business scenarios.

Collaborative Development

It supports collaborative development among multiple people within the same project, including code version management and code rollback.

Workflow Scheduling

Offline development is scheduled and executed in the dimension of workflows, generating workflow execution instances, with automatic dependency management for task nodes within the workflow.

Intelligent Operations and Maintenance

The platform provides intelligent dependent task recommendations, intelligent scheduling, intelligent operations and maintenance, and intelligent baseline alerts. It supports batch data replenishment, re-execution of tasks, and more.

Data Quality

The platform integrates data quality audit components to monitor the entire process of data ingestion and processing, ensuring data accuracy and consistency.

Data Security

The platform employs a dual control mechanism of functional permissions and data permissions, supports Kerberos authentication integration, and achieves fine-grained permission control.

Function Overview

It provides visual components for creating various types of offline development tasks, supports visual task development with WEB SQL, allows online debugging and viewing of runtime logs, and supports the incorporation of custom functions. Task configuration is simple and flexible, reducing learning costs and enhancing product usability.

Application Scenarios

Multi-Cluster/Engine Data Warehouse Construction

With the rapid growth of enterprise data scale, the demand for data processing and storage has become more diverse. A single type of data warehouse can no longer meet actual business scenarios. The offline development platform integrates multiple computing engines, enabling the integration of various types and sources of data to construct warehouse marts for different data types. It supports the management of different clusters/engines and facilitates collaborative development and unified management by large-scale project teams.

Large-Scale Data Workflow Development

In large-scale data development scenarios, traditional development tools require the creation of one or more complex tasks, with high coupling of code logic for handling business scenarios, leading to difficulties in operations and maintenance. The Keen TECH offline development platform adopts workflow design, allowing the creation of development workflows according to different business scenarios. By forming task flows through automatic dependency management among multiple tasks, it reduces the complexity of data processing and improves development and operations efficiency.