tencent cloud

Elastic MapReduce

Release Notes and Announcements
Release Notes
Announcements
Security Announcements
Product Introduction
Overview
Strengths
Architecture
Features
Use Cases
Constraints and Limits
Technical Support Scope
Product release
Purchase Guide
EMR on CVM Billing Instructions
EMR on TKE Billing Instructions
EMR Serverless HBase Billing Instructions
Getting Started
EMR on CVM Quick Start
EMR on TKE Quick Start
EMR on CVM Operation Guide
Planning Cluster
Administrative rights
Configuring Cluster
Managing Cluster
Managing Service
Monitoring and Alarms
TCInsight
EMR on TKE Operation Guide
Introduction to EMR on TKE
Configuring Cluster
Cluster Management
Service Management
Monitoring and Ops
Application Analysis
EMR Serverless HBase Operation Guide
EMR Serverless HBase Product Introduction
Quotas and Limits
Planning an Instance
Managing an Instance
Monitoring and Alarms
Development Guide
EMR Development Guide
Hadoop Development Guide
Spark Development Guide
Hbase Development Guide
Phoenix on Hbase Development Guide
Hive Development Guide
Presto Development Guide
Sqoop Development Guide
Hue Development Guide
Oozie Development Guide
Flume Development Guide
Kerberos Development Guide
Knox Development Guide
Alluxio Development Guide
Kylin Development Guide
Livy Development Guide
Kyuubi Development Guide
Zeppelin Development Guide
Hudi Development Guide
Superset Development Guide
Impala Development Guide
Druid Development Guide
TensorFlow Development Guide
Kudu Development Guide
Ranger Development Guide
Kafka Development Guide
Iceberg Development Guide
StarRocks Development Guide
Flink Development Guide
JupyterLab Development Guide
MLflow Development Guide
Practical Tutorial
Practice of EMR on CVM Ops
Data Migration
Practical Tutorial on Custom Scaling
API Documentation
History
Introduction
API Category
Cluster Resource Management APIs
Cluster Services APIs
User Management APIs
Data Inquiry APIs
Scaling APIs
Configuration APIs
Other APIs
Serverless HBase APIs
YARN Resource Scheduling APIs
Making API Requests
Data Types
Error Codes
FAQs
EMR on CVM
Service Level Agreement
Contact Us

Log

PDF
포커스 모드
폰트 크기
마지막 업데이트 시간: 2026-01-13 17:37:54

Overview

The log feature provides component running log collection, search, and export capabilities. It supports keyword searches across core service logs and node system logs of the current cluster, enabling quick access to key service logs without logging in to the nodes.

Directions

1. Log in to the EMR console and click the ID/Name of the target cluster in the cluster list.
2. On the cluster details page, choose Cluster Monitoring > Log to filter and view log content by current cluster, log file, node IP, and time range.
Alternatively, choose Cluster Service > target component block > Role Management, click a Node IP in Role List to enter the page where the node monitoring metrics are displayed, and then click Role Log to enter the Log Search page.
Click a Node IP to enter the Node Status page, or click Log Source to enter the page where the node monitoring metrics are displayed.

Keyword description:
Supports full-text search based on keywords.
Supports search by using special symbols, including hyphen (-), period (.), asterisk (*), greater-than sign (>), less-than sign (<), equal sign (=), exclamation mark (!), brackets (() and {}), and forward slash (/).
Supports phrase-based search. Example: address=/ip:port.
3. During troubleshooting, you usually need to pay attention to contextual logs of keywords. On the Log Search page, click View Context to enter the Log Context page.
4. Supports filtering log results and source log export. Exported logs can be downloaded to local.
5. Supports cluster log delivery to ES Serverless or CLS log service.
Note:
Supports sending runtime logs, audit logs, user task logs, and other custom logs to ES serverless.
Supports sending runtime logs and service audit logs to CLS.
Note:
Currently, only logs in the past 30 days can be searched for.
If log collection has not been enabled on your cluster, you can contact your Tencent Cloud rep for assistance.
Only partial services enable audit log collection by default. If the cluster requires audit log collection, contact your exclusive after-sales support.
Component
Role
Log
Description
HDFS
NameNode
/data/emr/hdfs/logs/hadoop-hadoop-namenode.log
NameNode runtime log
NNAudit
/data/emr/hdfs/logs/nn-audit.log
NameNode audit log
ZKFC
/data/emr/hdfs/logs/hadoop-hadoop-zkfc.log
ZKFC runtime log
ZKFCAudit
/data/emr/hdfs/logs/SecurityAuth-zkfc-audit.log
ZKFC audit log
DataNode
/data/emr/hdfs/logs/hadoop-hadoop-datanode.log
DataNode runtime log
DNAudit
/data/emr/hdfs/logs/SecurityAuth-datanode-audit.log
DataNode audit log
JournalNode
/data/emr/hdfs/logs/hadoop-hadoop-journalnode.log
JournalNode runtime log
JNAudit
/data/emr/hdfs/logs/SecurityAuth-journalnode-audit.log 
JournalNode audit log
DFSRouter
/data/emr/hdfs/logs/hadoop-hadoop-dfsrouter.log
DFSRouter runtime log
YARN
ResourceManager
/data/emr/yarn/logs/yarn-hadoop-resourcemanager.log
ResourceManager runtime log
RMAudit
/data/emr/yarn/logs/ rm-audit.log
ResourceManager audit log
NodeManager
/data/emr/yarn/logs/yarn-hadoop-nodemanager.log
NodeManager runtime log
NMAudit
/data/emr/yarn/logs/nm-audit.log
NodeManager audit log
JobHistoryServer
/data/emr/yarn/logs/mapred-hadoop-historyserver.log
JobHistoryServer runtime log
TimelineServer
/data/emr/yarn/logs/yarn-hadoop-timelineserver.log
TimelineServer runtime log
HBase
HMaster
/data/emr/hbase/logs/hbase-hadoop-master.log
HMaster runtime log
HMAudit
/data/emr/hbase/logs/SecurityAuth-hmaster-audit.log
HMaster audit log
ThriftServer
/data/emr/hbase/logs/hbase-hadoop-thrift.log
ThriftServer runtime log
RegionServer
/data/emr/hbase/logs/hbase-hadoop-regionserver.log
RegionServer runtime log
RSAudit
/data/emr/hbase/logs/SecurityAuth-regionserver-audit.log
RegionServer audit log
RestServer
/data/emr/hbase/logs/hbase-hadoop-rest.log
RestServer runtime log
ClickHouse
ClickHouse-server
/data/clickhouse/clickhouse-server/logs/clickhouse-server.log
ClickHouse-server runtime log
Druid
Broker
/data/emr/druid/var/log/druid/broker.log
Broker runtime log
Coordinator
/data/emr/druid/var/log/druid/coordinator.log
Coordinator runtime log
Router
/data/emr/druid/var/log/druid/router.log
Router runtime log
Overload
/data/emr/druid/var/log/druid/overload.log
Overload runtime log
Historical
/data/emr/druid/var/log/druid/historical.log
Historical runtime log
MiddleManager
/data/emr/druid/var/log/druid/middleManager.log
MiddleManager runtime log
ZooKeeper
ZooKeeper
/data/emr/zookeeper/logs/zookeeper-root-server.log
ZooKeeper runtime log
ZKAudit
/data/emr/zookeeper/logs/zookeeper-audit.log
Zookeeper audit log
Hive
HiveServer2
/data/emr/hive/logs/hadoop-hive
HiveServer2 runtime log
HS2Audit
/data/emr/hive/logs/hadoop_hive_server2_audit
HiveServer2 audit log
HMSAudit
/data/emr/hive/logs/hadoop-hivemetastore
HiveMetaStore audit log
Kudu
KuduMaster
/data/emr/kudu/logs/kudu-master.WARNING
KuduMaster runtime log
KuduServer
/data/emr/kudu/logs/kudu-tserver.WARNING
KuduServer runtime log
Alluxio
AlluxioMaster
/data/emr/alluxio/logs/master.log
AlluxioMaster runtime log
AlluxioWorker
/data/emr/alluxio/logs/worker.log
AlluxioWorker runtime log
Ranger
EmbeddedServer
/data/emr/ranger/logs/ranger-admin.log
EmbeddedServer runtime log
CosRanger
CosRangerServer
/usr/local/service/cosranger/log/info.log
COSRanger runtime log
Impala
Catalogd
/data/emr/impala/logs/catalogd.INFO
Catalogd runtime log
Statestored
/data/emr/impala/logs/statestored.INFO
Statestored runtime log
Impalad
/data/emr/impala/logs/impalad.INFO
Impalad runtime log
Spark
HistoryServer
/data/emr/spark/logs/spark-hadoop.log
HistoryServer runtime log
SparkSQLAudit
/data/emr/spark/logs/spark-audit.log
Spark audit log
(EMR V2.7.0 or later & EMR V3.4.0 or later
Kylin
Kylin
/data/emr/kylin/logs/kylin.log
Kylin runtime log
Zeppelin
ZeppelinServer
/data/emr/zeppelin/logs/zeppelin-hadoop.log
ZeppelinServer runtime log
Knox
Gateway
/data/emr/knox/logs/gateway.log
Gateway runtime log
Doris
BrokerBootstrap
/data/emr/doris/broker/log/apache_hdfs_broker.log
BrokerBootstrap runtime log
PaloFe
/data/emr/doris/fe/log/fe.log
PaloFe runtime log
PaloBe
/data/emr/doris/be/log/be.INFO
PaloBe runtime log
Kafka
Kafka
/user/local/service/kafka/logs/server.log
Kafka runtime log
Kyuubi-on CVM
KyuubiServer
/data/emr/kyuubi/logs/kyuubi.log /data/emr/kyuubi/logs/kyuubi-hadoop-org.apache.kyuubi.server.KyuubiServer-hostIp.out
KyuubiServer runtime log
KyuubiWorkLog
/data/emr/log/work/.../xxx.log
KyuubiWorkLog user log (created after June 24, 20
Kyuubi-on TKE
KyuubiServer
/data1/emr/kyuubi/logs/kyuubi--org.apache.kyuubi.server.KyuubiServer-hostName.out
KyuubiServer runtime log
KyuubiWorkLog
/data1/emr/kyuubi/work/.../xxx.log
KyuubiWorkLog user log
Trino
Coordinator
/data/emr/trino/logs/coordinator.log
Coordinator runtime log (EMR V3.4.0 and above
Worker
/data/emr/trino/logs/worker.log
Worker runtime log
(EMR V3.4.0 or later
Coordinator
/data/emr/trino/var/logs/coordinator.log
Coordinator runtime log (EMR V2.7.0 and above
Worker
/data/emr/trino/var/logs/worker.log
Worker runtime log
(EMR V2.7.0 or later
StarRocks
FE
/data/emr/starrocks/fe/log/fe.log
FE runtime log
BE
/data/emr/starrocks/be/log/be.INFO
BE runtime log
Broker
/data/emr/starrocks/broker/log/apache_hdfs_broker.log
Broker runtime log
CN
/data/emr/starrocks/be/log/cn.INFO
CN runtime log

Minimum Log Level Supported by Services

Service
Default Minimum Log Level
Impala and Kudu
INFO
Other services
WARN

Query Rules for the Minimum Log Level

Minimum Log Level
Queryable Log Levels
INFO
INFO, WARN, ERROR, FATAL
WARN
WARN, ERROR, FATAL
ERROR
ERROR, FATAL
FATAL
FATAL

도움말 및 지원

문제 해결에 도움이 되었나요?

피드백