{"id":6490,"date":"2021-08-08T20:14:18","date_gmt":"2021-08-08T14:44:18","guid":{"rendered":"https:\/\/blog.pheonixsolutions.com\/?p=6490"},"modified":"2021-08-08T20:14:20","modified_gmt":"2021-08-08T14:44:20","slug":"error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files","status":"publish","type":"post","link":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/","title":{"rendered":"ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files"},"content":{"rendered":"\n

Please follow the below steps when you get the above error.<\/p>\n\n\n\n

I got this error in KAFKA and everytime its getting down due to this.<\/p>\n\n\n\n

In Kafka, every topic is (optionally) split into many partitions. For each partition some files are maintained by brokers (for index and actual data).<\/p>\n\n\n\n

kafka-topics –zookeeper localhost:2181 –describe –topic topic_name<\/p>\n\n\n\n

The above command will give you the number of partitions for topic\u00a0topic_name<\/code>. The default number of partitions per topic\u00a0num.partitions<\/code>\u00a0is defined under\u00a0\/etc\/kafka\/server.properties<\/code><\/p>\n\n\n\n

The total number of open files could be very huge if the broker hosts many partitions and a particular partition has many log segment files.<\/p>\n\n\n\n

You can see the current file descriptor limit by running<\/p>\n\n\n\n

ulimit -n\u00a0<\/p>\n\n\n\n

To solve the issue you either need to change the limit of open file descriptors:<\/p>\n\n\n\n

ulimit -n <noOfFiles><\/p>\n\n\n\n

or somehow reduce the number of open files (for example, reduce number of partitions per topic).<\/p>\n","protected":false},"excerpt":{"rendered":"

Please follow the below steps when you get the above error. I got this error in KAFKA and everytime its getting down due to this. In Kafka, every topic is (optionally) split into many partitions. For each partition some files are maintained by brokers (for index and actual data). kafka-topics… Continue Reading ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files<\/span><\/i><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[245,303],"tags":[900,901],"class_list":{"0":"post-6490","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"hentry","6":"category-3rdparty","7":"category-devops","8":"tag-kafka","9":"tag-too-many-open-files","10":"h-entry","12":"h-as-article"},"yoast_head":"\nPheonix Solutions - We Empower Your Business Growth<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Pheonix Solutions - We Empower Your Business Growth\" \/>\n<meta property=\"og:description\" content=\"Please follow the below steps when you get the above error. I got this error in KAFKA and everytime its getting down due to this. In Kafka, every topic is (optionally) split into many partitions. For each partition some files are maintained by brokers (for index and actual data). kafka-topics… Continue Reading ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files\" \/>\n<meta property=\"og:url\" content=\"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/\" \/>\n<meta property=\"og:site_name\" content=\"PHEONIXSOLUTIONS\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/PheonixSolutions-209942982759387\/\" \/>\n<meta property=\"article:published_time\" content=\"2021-08-08T14:44:18+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-08-08T14:44:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/pheonixsolutions.com\/blog\/wp-content\/uploads\/2016\/09\/PX2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"3837\" \/>\n\t<meta property=\"og:image:height\" content=\"2540\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@pheonixsolution\" \/>\n<meta name=\"twitter:site\" content=\"@pheonixsolution\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#\\\/schema\\\/person\\\/0ffa33d73c869faec2d50e79c24e3503\"},\"headline\":\"ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files\",\"datePublished\":\"2021-08-08T14:44:18+00:00\",\"dateModified\":\"2021-08-08T14:44:20+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/\"},\"wordCount\":166,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#organization\"},\"keywords\":[\"Kafka\",\"too many open files\"],\"articleSection\":[\"3rdparty\",\"Devops\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/\",\"url\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/\",\"name\":\"Pheonix Solutions - We Empower Your Business Growth\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#website\"},\"datePublished\":\"2021-08-08T14:44:18+00:00\",\"dateModified\":\"2021-08-08T14:44:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/\",\"name\":\"Pheonix Solutions\",\"description\":\"We Empower Your Business Growth\",\"publisher\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#organization\",\"name\":\"PheonixSolutions\",\"url\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/12\\\/logo.png\",\"contentUrl\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/wp-content\\\/uploads\\\/2016\\\/12\\\/logo.png\",\"width\":454,\"height\":300,\"caption\":\"PheonixSolutions\"},\"image\":{\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/PheonixSolutions-209942982759387\\\/\",\"https:\\\/\\\/x.com\\\/pheonixsolution\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/#\\\/schema\\\/person\\\/0ffa33d73c869faec2d50e79c24e3503\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"http:\\\/\\\/blog.pheonixsolutions.com\"],\"url\":\"https:\\\/\\\/pheonixsolutions.com\\\/blog\\\/author\\\/admin\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Pheonix Solutions - We Empower Your Business Growth","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/","og_locale":"en_US","og_type":"article","og_title":"Pheonix Solutions - We Empower Your Business Growth","og_description":"Please follow the below steps when you get the above error. I got this error in KAFKA and everytime its getting down due to this. In Kafka, every topic is (optionally) split into many partitions. For each partition some files are maintained by brokers (for index and actual data). kafka-topics… Continue Reading ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files","og_url":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/","og_site_name":"PHEONIXSOLUTIONS","article_publisher":"https:\/\/www.facebook.com\/PheonixSolutions-209942982759387\/","article_published_time":"2021-08-08T14:44:18+00:00","article_modified_time":"2021-08-08T14:44:20+00:00","og_image":[{"width":3837,"height":2540,"url":"https:\/\/pheonixsolutions.com\/blog\/wp-content\/uploads\/2016\/09\/PX2.png","type":"image\/png"}],"author":"admin","twitter_card":"summary_large_image","twitter_creator":"@pheonixsolution","twitter_site":"@pheonixsolution","twitter_misc":{"Written by":"admin","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/#article","isPartOf":{"@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/"},"author":{"name":"admin","@id":"https:\/\/pheonixsolutions.com\/blog\/#\/schema\/person\/0ffa33d73c869faec2d50e79c24e3503"},"headline":"ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files","datePublished":"2021-08-08T14:44:18+00:00","dateModified":"2021-08-08T14:44:20+00:00","mainEntityOfPage":{"@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/"},"wordCount":166,"commentCount":0,"publisher":{"@id":"https:\/\/pheonixsolutions.com\/blog\/#organization"},"keywords":["Kafka","too many open files"],"articleSection":["3rdparty","Devops"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/","url":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/","name":"Pheonix Solutions - We Empower Your Business Growth","isPartOf":{"@id":"https:\/\/pheonixsolutions.com\/blog\/#website"},"datePublished":"2021-08-08T14:44:18+00:00","dateModified":"2021-08-08T14:44:20+00:00","breadcrumb":{"@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/pheonixsolutions.com\/blog\/error-error-while-accepting-connection-kafka-network-acceptor-java-io-ioexception-too-many-open-files\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/pheonixsolutions.com\/blog\/"},{"@type":"ListItem","position":2,"name":"ERROR Error while accepting connection (kafka.network.Acceptor) java.io.IOException: Too many open files"}]},{"@type":"WebSite","@id":"https:\/\/pheonixsolutions.com\/blog\/#website","url":"https:\/\/pheonixsolutions.com\/blog\/","name":"Pheonix Solutions","description":"We Empower Your Business Growth","publisher":{"@id":"https:\/\/pheonixsolutions.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/pheonixsolutions.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/pheonixsolutions.com\/blog\/#organization","name":"PheonixSolutions","url":"https:\/\/pheonixsolutions.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/pheonixsolutions.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/pheonixsolutions.com\/blog\/wp-content\/uploads\/2016\/12\/logo.png","contentUrl":"https:\/\/pheonixsolutions.com\/blog\/wp-content\/uploads\/2016\/12\/logo.png","width":454,"height":300,"caption":"PheonixSolutions"},"image":{"@id":"https:\/\/pheonixsolutions.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/PheonixSolutions-209942982759387\/","https:\/\/x.com\/pheonixsolution"]},{"@type":"Person","@id":"https:\/\/pheonixsolutions.com\/blog\/#\/schema\/person\/0ffa33d73c869faec2d50e79c24e3503","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/09bacc0294abee1322a23ab4bc6a0330dd4cb4df707dc9d0b0efeba6c109608b?s=96&r=g","caption":"admin"},"sameAs":["http:\/\/blog.pheonixsolutions.com"],"url":"https:\/\/pheonixsolutions.com\/blog\/author\/admin\/"}]}},"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p7F4uM-1GG","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/posts\/6490","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/comments?post=6490"}],"version-history":[{"count":0,"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/posts\/6490\/revisions"}],"wp:attachment":[{"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/media?parent=6490"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/categories?post=6490"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/pheonixsolutions.com\/blog\/wp-json\/wp\/v2\/tags?post=6490"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}