admin管理员组

文章数量:1529446

翻译Memory Limits

Kudu has a hard and soft memory limit. The hard memory limit is the maximum amount a Kudu process is allowed to use, and is controlled by the --memory_limit_hard_bytes flag. The soft memory limit is a percentage of the hard memory limit, controlled by the flag memory_limit_soft_percentage and with a default value of 80%, that determines the amount of memory a process may use before it will start rejecting some write operations.

There are several ways to relieve the memory pressure on Kudu:

  • If the host has more memory available for Kudu, increase --memory_limit_hard_bytes.
  • Increase the rate at which Kudu can flush writes from memory to disk by increasing the number of disks or increasing --maintenance_manager_num_threads. Generally, the recommended ratio of maintenance manager threads to data directories is 1:3.
  • Reduce the volume of writes flowing to Kudu on the application side.

简单总结为
减少kudu内存压力的几种方式为：

  • 增加内存 通过设置 --memory_limit_hard_bytes.
  • 增加kudu将内存往磁盘中刷写数据的效率
    1.增加磁盘数量
    2.增加 maintenance_manager_num_threads
  • 在应用端减少写入流量

本文标签： 内存KUDUMemoryLimits

版权声明：本文标题：KUDU Memory Limits 内存限制 内容由热心网友自发贡献，该文观点仅代表作者本人， 转载请联系作者并注明出处：https://m.elefans.com/dongtai/1726704633a1081522.html， 本站仅提供信息存储空间服务，不拥有所有权，不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容，一经查实，本站将立刻删除。