setMetadataRefreshIntervalMs( $kafka['metadataRefreshIntervalMs'] ?? 1000 ); $config->setMetadataBrokerList($kafka['brokers']); $config->setGroupId($kafka['groupId']); $config->setBrokerVersion($kafka['version']); $config->setTopics($kafka['topics']); $this->channelListener($kafka); return [new Consumer(), $kafka]; } /** * @param Process $process * @throws ConfigException */ public function onHandler(Process $process) { [$consumer, $kafka] = $this->initConfig(); if ($kafka['debug'] ?? true) { $consumer->setLogger(new Logger()); } $consumer->start(function ($topic, $part, $message) { $this->channel->push([$topic, $part, $message]); }); } /** * 监听通道数据传递 * @param $config */ public function channelListener($config) { if (!isset($config['size'])) { $config['size'] = 100; } $this->channel = new Channel($config['size']); Coroutine::create(function () use ($config) { $group = new WaitGroup(); for ($i = 0; $i < $config['size']; $i++) { $group->add(); go(function () use ($group) { defer(function () use ($group) { $group->done(); }); while ($messages = $this->channel->pop()) { $this->handlerExecute($messages[0], $messages[1], $messages[2]); } }); } $group->wait(); }); } /** * @param $topic * @param $part * @param $message */ protected function handlerExecute($topic, $part, $message) { try { $namespace = 'App\\Kafka\\' . ucfirst($topic) . 'Consumer'; if (!class_exists($namespace)) { return; } $class = Snowflake::createObject($namespace); if (!($class instanceof ConsumerInterface)) { return; } $class->onHandler(new Struct($topic, $part, $message)); } catch (\Throwable $exception) { $this->application->error($exception->getMessage()); } } }