Advanced Hadoop Tuning and Optimization - Hadoop Consulting
•Télécharger en tant que PPT, PDF•
107 j'aime•23,429 vues
Impetus provides expert consulting services around Hadoop implementations, including R&D, assessment, deployment (on private and public clouds), optimizations for enhanced static shared data implementations. This presentation speaks about Advanced Hadoop Tuning and Optimisation.
![Hadoop- The Good/Bad/Ugly ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Download the Whitepaper: Deriving Intelligence from Large Data Using Hadoop and Applying Analytics at http://bit.ly/cNCCGj](data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7)
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Advanced Hadoop Tuning and Optimization - Hadoop Consulting
Similaire à Advanced Hadoop Tuning and Optimization - Hadoop Consulting (20)
Plus de Impetus Technologies
Plus de Impetus Technologies (20)
Dernier
Dernier (20)
Advanced Hadoop Tuning and Optimization - Hadoop Consulting
- 1. Presented By: Sanjay Sharma Advanced Hadoop Tuning and Optimizations Download the Whitepaper: Deriving Intelligence from Large Data Using Hadoop and Applying Analytics at http://bit.ly/cNCCGj
- 13. Other hotspots
Notes de l'éditeur
- e.g. a node has 8GB main memory + 8 core CPU + swap space Maximum memory required by a task ~ 500MB Memory required by Tasktracker, Datanode and other processes ~ (1 + 1 +1) = 3GB Maximum tasks that can be run = (8-3) GB/500MB = 10 Number of map or reduce task (out of the maximum tasks) can be decided on the basis of memory usage and computation complexities of the tasks. The memory available to each task (JVM) is controlled by mapred.child.java.opts property. The default is –Xmx200m (200 MB). Other JVM options can also be provided in this property.