Presentation
A Novel Approach to Cost-Efficient Hybrid Cloud Solutions with SeaScape's Data Lake and Micro-Resiliency
Descriptionarm has always been exploring the cloud advantages and is quite motivated to be fully Cloud enabled. On cloud, spot instances have always been the cost effective solution but not many EDA tools can leverage this advantage. Spot instances offer a cost-effective solution by taking advantage of unused cloud resources. arm has already adopted spot instances for small/short workloads like APL characterizations.The runtime of Redhawk-SC EMIR runs is high, leading to a higher susceptibility for failure due to extended durations and more resource requirement. Goal is for RHSC to harnesses this capability for large work loads, to provide a Viable Option to Optimize the user's Cloud Expenses.
The new DataLake feature offers a more cost-effective solution by dividing workers into two categories. Execution workers are launched on spot instances and are responsible solely for the execution of jobs and with micro-resiliency, the eviction of spot instances is handled gracefully. On the other hand, DataLake workers are launched on reserved instances to ensure reliability since they are file servers. By dividing workers into these two categories and leveraging the capabilities of reserved and spot instances, this approach enables a highly scalable and cost-efficient system with robust micro-resiliency.
DataLake runs on aarch64 machines were completed successfully inspite of spot instances eviction. There is reduction in cost seen on DataLake runs as compared to reserved with minimal impact on run time and no change in QoR.
The new DataLake feature offers a more cost-effective solution by dividing workers into two categories. Execution workers are launched on spot instances and are responsible solely for the execution of jobs and with micro-resiliency, the eviction of spot instances is handled gracefully. On the other hand, DataLake workers are launched on reserved instances to ensure reliability since they are file servers. By dividing workers into these two categories and leveraging the capabilities of reserved and spot instances, this approach enables a highly scalable and cost-efficient system with robust micro-resiliency.
DataLake runs on aarch64 machines were completed successfully inspite of spot instances eviction. There is reduction in cost seen on DataLake runs as compared to reserved with minimal impact on run time and no change in QoR.
Event Type
Engineering Track Poster
TimeMonday, June 245:00pm - 6:00pm PDT
LocationLevel 2 Exhibit Hall
Back-End Design
Embedded Systems
Front-End Design
IP