Unit 13 - AI Data Center Management and Monitoring Flashcards
Identify the general concepts about provisioning, managing and monitoring ai infrastructure Describe the value of ai management tools Describe the concepts of ongoing monitoring and maintenance Identify tools for provisioning, management, and monitoring
Infrastructure provisioning
Infrastructure provisioning provisioning is the process of setting up and configuring hardware. This includes the servers, swtiches, storage, and any other components of AI cluster.
Resource management and monitoring
Resource management and monitoring This includes getting metrics and data from the resources in the cluster to determine how the cluster is performing and to make any updates or changes.
Workload management and monitoring
Workload management and monitoring This is how we ensure the data scientists and Al practitioners have the tools they need and understand the usage of the cluster.
NVIDIA Base Command Manager (BCM)
NVIDIA Base Command Manager (BCM) is a proprietary, comprehensive software platform designed for infrastructure provisioning, resource management, and workload monitoring and management. It streamlines cluster provisioning, workload management, and infrastructure monitoring, providing all the tools needed to deploy and manage an AI data center.
