Skip to main content

jBEAM集群

Cluster Logo

Parallelize analyses with jBEAM Cluster
One Data Lake with multiple jBEAM instances

jBEAM cluster

产品概述

下载

You are interested in jBEAM Cluster or still have some questions left unanswered?

Please contact us using our contact form and we'll be glad to assist you!

Within one data lake, several instances of jBEAM, which are located in a jBEAM Cluster, analyze different measurement data simultaneously. Subsequently, the partial results will be aggregated to one final result.

jBEAM Cluster:

  • An analysis, which is created in one jBEAM, is processed in parallel in a jBEAM Cluster with several jBEAM instances.
  • A jBEAM Cluster consists of several PCs, on which one or more jBEAM instances (nodes) are running.
  • Each cluster node processes one file, sends the result back to the aggregator and informs the cluster manager about its actual status (e.g. finished and ready for the next file).
  • This method corresponds to a MapReduce with files. Splitting the files is not necessary.
  • After all files are processed, the aggregator combines all partial results and sends them - as a final result - back to the user (client) via network.
  • Conventional file systems (e.g. Windows, NAS, Linux, …) as well as the Hadoop Distributed File System (HDFS) can be used.
  • 存储/应用服务器
  • 带独立存储的多CPU服务器
  • 快捷安装
  • 高性能
  • 用于大测试数据的新文件系统
  • 各自带CPU和存储的多节点
  • 成组相关文件*
  • 横向可扩展
  • 兼容Java NIO*
  • 无文件转换*
  • 工程师所需的数据挖掘*
  • 最高性能

                                                    *HDFS不具备

Vorteile jBEAM Cluster

Transferring vast amount of data will be unnecessary

No raw data is transferred to the user PC. Only the end result is send back to the user.

Calculations are brought to the data

Calculation will be run where the data is actually located.

Integrable into the measurement data management system MaDaM

For desktop applications as well as for global MDM systems.

Components for Cluster Operation:

  1. File Importer
    A file importer defines, how to import the files (jBEAM supports more than 100 data formats)
  2. Data Reduction Calculations
    Statistical (Min, Max, …), Event-Detection, Histogram, Rainflow, …
  3. Aggregator
    Component, which defines how the results should be aggregated (sum, append, …)
  4. Multi-File-Analysis-Controller (MFAC)
    jBEAM side controller to create cluster jobs
  5. Cluster Service
    There are different types of cluster services:

    • One node - Sequential operation
    • Local Cluster - jBEAM instances in own Java VM
    • External Cluster (see figure on the right) - Built with several PCs, each with one or Nx nodes (jBEAMs)
    • External High Performance Cluster - Plenty of high performance Linux PCs


More Information about jBEAM Cluster

jBEAM im Clusterverbund