Kafka Connect - metrics through JMX The Next CEO of Stack OverflowUnable to pull JMX data using jolokia from KafkaKafka connect throttlingIssues while running kafka connect in distributed modeSetup kafka-connect to fetch data from remote brokersWhat should I use: Kafka Stream or Kafka consumer api or Kafka connectCollecting Performance metrics for kafka connect using hdfs sink connectorConfluent 5.0.0 kafka connect hdfs sink: Cannot describe the kafka connect consumer group lag after upgradeSetup multiple kafka connect sinksKafka Connect Hdfs Sink Connector - Class io.confluent.connect.hdfs.string.StringFormat could not be foundGathering `kafka.producer` metrics using JMXkafka consumer lag from jmx metrics vs consumer-groups.sh script
What happened in Rome, when the western empire "fell"?
(How) Could a medieval fantasy world survive a magic-induced "nuclear winter"?
Are the names of these months realistic?
It is correct to match light sources with the same color temperature?
What was Carter Burke's job for "the company" in Aliens?
What steps are necessary to read a Modern SSD in Medieval Europe?
If Nick Fury and Coulson already knew about aliens (Kree and Skrull) why did they wait until Thor's appearance to start making weapons?
Can Sneak Attack be used when hitting with an improvised weapon?
Can I board the first leg of the flight without having final country's visa?
Does higher Oxidation/ reduction potential translate to higher energy storage in battery?
Is it correct to say moon starry nights?
how one can write a nice vector parser, something that does pgfvecparseA=B-C; D=E x F;
Which one is the true statement?
Point distance program written without a framework
How to avoid supervisors with prejudiced views?
Reshaping json / reparing json inside shell script (remove trailing comma)
Is there a difference between "Fahrstuhl" and "Aufzug"?
Is fine stranded wire ok for main supply line?
Physiological effects of huge anime eyes
Aggressive Under-Indexing and no data for missing index
Does Germany produce more waste than the US?
IC has pull-down resistors on SMBus lines?
Ising model simulation
From jafe to El-Guest
Kafka Connect - metrics through JMX
The Next CEO of Stack OverflowUnable to pull JMX data using jolokia from KafkaKafka connect throttlingIssues while running kafka connect in distributed modeSetup kafka-connect to fetch data from remote brokersWhat should I use: Kafka Stream or Kafka consumer api or Kafka connectCollecting Performance metrics for kafka connect using hdfs sink connectorConfluent 5.0.0 kafka connect hdfs sink: Cannot describe the kafka connect consumer group lag after upgradeSetup multiple kafka connect sinksKafka Connect Hdfs Sink Connector - Class io.confluent.connect.hdfs.string.StringFormat could not be foundGathering `kafka.producer` metrics using JMXkafka consumer lag from jmx metrics vs consumer-groups.sh script
I am using confluent HDFS sink connector and would like to know how to get consumer properties to expose through either JMX or REST API.
I checked the following two properties, however, I don't know how to expose metrics to jmx port
- connect-standalone.properties
- consumer.properties
apache-kafka kafka-consumer-api apache-kafka-connect
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
add a comment |
I am using confluent HDFS sink connector and would like to know how to get consumer properties to expose through either JMX or REST API.
I checked the following two properties, however, I don't know how to expose metrics to jmx port
- connect-standalone.properties
- consumer.properties
apache-kafka kafka-consumer-api apache-kafka-connect
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58
add a comment |
I am using confluent HDFS sink connector and would like to know how to get consumer properties to expose through either JMX or REST API.
I checked the following two properties, however, I don't know how to expose metrics to jmx port
- connect-standalone.properties
- consumer.properties
apache-kafka kafka-consumer-api apache-kafka-connect
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
I am using confluent HDFS sink connector and would like to know how to get consumer properties to expose through either JMX or REST API.
I checked the following two properties, however, I don't know how to expose metrics to jmx port
- connect-standalone.properties
- consumer.properties
apache-kafka kafka-consumer-api apache-kafka-connect
apache-kafka kafka-consumer-api apache-kafka-connect
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
edited Mar 7 at 21:49
Robin Moffatt
8,1271429
8,1271429
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
asked Mar 7 at 18:31
Gaurang ShahGaurang Shah
3,51321537
3,51321537
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58
add a comment |
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58
add a comment |
1 Answer
1
active
oldest
votes
Set JMX_PORT when you launch Kafka Connect. e.g.
export JMX_PORT=4242
./bin/connect-distributed ./etc/kafka/connect-distributed.properties
You can then connect to JMX using JConsole, JMXTerm, etc.
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
I modified the file./bin/connect-distributedand mentioned the port inside itJMX_PORT=4242and then restarted the service. However it's not working
– Gaurang Shah
Mar 11 at 15:06
add a comment |
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55050586%2fkafka-connect-metrics-through-jmx%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Set JMX_PORT when you launch Kafka Connect. e.g.
export JMX_PORT=4242
./bin/connect-distributed ./etc/kafka/connect-distributed.properties
You can then connect to JMX using JConsole, JMXTerm, etc.
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
I modified the file./bin/connect-distributedand mentioned the port inside itJMX_PORT=4242and then restarted the service. However it's not working
– Gaurang Shah
Mar 11 at 15:06
add a comment |
Set JMX_PORT when you launch Kafka Connect. e.g.
export JMX_PORT=4242
./bin/connect-distributed ./etc/kafka/connect-distributed.properties
You can then connect to JMX using JConsole, JMXTerm, etc.
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
I modified the file./bin/connect-distributedand mentioned the port inside itJMX_PORT=4242and then restarted the service. However it's not working
– Gaurang Shah
Mar 11 at 15:06
add a comment |
Set JMX_PORT when you launch Kafka Connect. e.g.
export JMX_PORT=4242
./bin/connect-distributed ./etc/kafka/connect-distributed.properties
You can then connect to JMX using JConsole, JMXTerm, etc.
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
Set JMX_PORT when you launch Kafka Connect. e.g.
export JMX_PORT=4242
./bin/connect-distributed ./etc/kafka/connect-distributed.properties
You can then connect to JMX using JConsole, JMXTerm, etc.
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
answered Mar 7 at 22:08
Robin MoffattRobin Moffatt
8,1271429
8,1271429
I modified the file./bin/connect-distributedand mentioned the port inside itJMX_PORT=4242and then restarted the service. However it's not working
– Gaurang Shah
Mar 11 at 15:06
add a comment |
I modified the file./bin/connect-distributedand mentioned the port inside itJMX_PORT=4242and then restarted the service. However it's not working
– Gaurang Shah
Mar 11 at 15:06
I modified the file
./bin/connect-distributed and mentioned the port inside it JMX_PORT=4242 and then restarted the service. However it's not working– Gaurang Shah
Mar 11 at 15:06
I modified the file
./bin/connect-distributed and mentioned the port inside it JMX_PORT=4242 and then restarted the service. However it's not working– Gaurang Shah
Mar 11 at 15:06
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55050586%2fkafka-connect-metrics-through-jmx%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
If you want to use REST, then use Jolokia and see stackoverflow.com/a/45984363/2308683
– cricket_007
Mar 8 at 16:58