smoke test: support ceph storage pools

[weizhouapache]

Description

This PR improves and fixes some tests on ceph storage

• enable direct download tests on ceph
• enable over provisioning tests on ceph
• enable volume snapshot tests on ceph
• fix test_human_readable_logs.py by increasing timeout of restarting to 120 seconds
• skip live vm migration for VMs with volume migration between ceph storage pools
• skip vm snapshots for VMs on ceph
• skip volume migration test between ceph storage pools (fixed by ceph: fix offline volume migration between ceph pools #12103)
• skip volume encryption tests on ceph

Types of changes

• Breaking change (fix or feature that would cause existing functionality to change)
• New feature (non-breaking change which adds functionality)
• Bug fix (non-breaking change which fixes an issue)
• Enhancement (improves an existing feature and functionality)
• Cleanup (Code refactoring and cleanup, that may add test cases)
• Build/CI
• Test (unit or integration test code)

Feature/Enhancement Scale or Bug Severity

Feature/Enhancement Scale

• Major
• Minor

Bug Severity

• BLOCKER
• Critical
• Major
• Minor
• Trivial

Screenshots (if appropriate):

How Has This Been Tested?

How did you try to break this feature and the system with this change?

[weizhouapache]

@blueorangutan package

[blueorangutan]

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 17.45%. Comparing base (223fc25) to head (844de76).

Additional details and impacted files

@@             Coverage Diff              @@
##               4.22   #11931      +/-   ##
============================================
- Coverage     17.56%   17.45%   -0.11%     
+ Complexity    15548    15513      -35     
============================================
  Files          5910     5913       +3     
  Lines        529129   529385     +256     
  Branches      64634    64677      +43     
============================================
- Hits          92942    92425     -517     
- Misses       425730   426543     +813     
+ Partials      10457    10417      -40     

Flag	Coverage Δ
uitests	3.58% <ø> (+<0.01%)	⬆️
unittests	18.51% <ø> (-0.12%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15584

[weizhouapache]

@blueorangutan test matrix

[blueorangutan]

@weizhouapache a [SL] Trillian-Jenkins matrix job (EL8 mgmt + EL8 KVM, Ubuntu22 mgmt + Ubuntu22 KVM, EL8 mgmt + VMware 7.0u3, EL9 mgmt + XCP-ng 8.2 ) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-14741)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 71700 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14741-kvm-ol8.zip
Smoke tests completed. 147 look OK, 2 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_migrate_VM_with_two_data_disks	Error	38.80	test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown	Error	288.49	test_vm_snapshots.py

[blueorangutan]

[SF] Trillian test result (tid-14742)
Environment: kvm-ubuntu22 (x2), zone: Advanced Networking with Mgmt server u22
Total time taken: 87202 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14742-kvm-ubuntu22.zip
Smoke tests completed. 146 look OK, 3 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_02_migrate_VM_with_two_data_disks	Error	38.29	test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown	Error	291.59	test_vm_snapshots.py
test_hostha_enable_ha_when_host_disabled	Error	3.67	test_hostha_kvm.py
test_hostha_enable_ha_when_host_in_maintenance	Error	305.91	test_hostha_kvm.py

[weizhouapache]

@blueorangutan package

[blueorangutan]

@weizhouapache a [SL] Jenkins job has been kicked to build packages. It will be bundled with KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

[blueorangutan]

Packaging result [SF]: ✔️ el8 ✔️ el9 ✔️ el10 ✔️ debian ✔️ suse15. SL-JID 15597

[weizhouapache]

@blueorangutan test

[blueorangutan]

@weizhouapache a [SL] Trillian-Jenkins test job (ol8 mgmt + kvm-ol8) has been kicked to run smoke tests

[blueorangutan]

[SF] Trillian test result (tid-14744)
Environment: xcpng82 (x2), zone: Advanced Networking with Mgmt server ol9
Total time taken: 129543 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14744-xcpng82.zip
Smoke tests completed. 139 look OK, 10 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_01_events_resource	Error	822.70	test_events_resource.py
test_08_upgrade_kubernetes_ha_cluster	Failure	3787.76	test_kubernetes_clusters.py
test_01_non_strict_host_anti_affinity	Error	520.75	test_nonstrict_affinity_group.py
test_02_non_strict_host_affinity	Error	130.06	test_nonstrict_affinity_group.py
test_02_list_snapshots_with_removed_data_store	Error	18.51	test_snapshots.py
test_02_list_snapshots_with_removed_data_store	Error	18.52	test_snapshots.py
test_01_ssl_offloading_isolated_network	Failure	949.48	test_ssl_offloading.py
test_01_vpn_usage	Error	1.18	test_usage.py
test_01_scale_up_verify	Failure	579.72	test_vm_autoscaling.py
test_11_destroy_vm_and_volumes	Error	30.02	test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown	Error	314.04	test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success	Error	78.07	test_vm_strict_host_tags.py

[blueorangutan]

[SF] Trillian test result (tid-14753)
Environment: kvm-ol8 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 58456 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14753-kvm-ol8.zip
Smoke tests completed. 149 look OK, 0 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File

[blueorangutan]

[SF] Trillian test result (tid-14743)
Environment: vmware-70u3 (x2), zone: Advanced Networking with Mgmt server ol8
Total time taken: 292096 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr11931-t14743-vmware-70u3.zip
Smoke tests completed. 136 look OK, 13 have errors, 0 did not run
Only failed and skipped tests results shown below:

Test	Result	Time (s)	Test File
test_08_upgrade_kubernetes_ha_cluster	Failure	3693.33	test_kubernetes_clusters.py
test_list_vms_metrics_admin	Error	3633.14	test_metrics_api.py
test_list_vms_metrics_history	Error	25.23	test_metrics_api.py
test_list_volumes_metrics_history	Error	3606.95	test_metrics_api.py
ContextSuite context=TestISOUsage>:setup	Error	0.00	test_usage.py
test_01_vpn_usage	Error	1.22	test_usage.py
test_01_deploy_vm_on_specific_host	Error	26.64	test_vm_deployment_planner.py
test_02_deploy_vm_on_specific_cluster	Error	3604.05	test_vm_deployment_planner.py
test_03_deploy_vm_on_specific_pod	Error	2.66	test_vm_deployment_planner.py
test_04_deploy_vm_on_host_override_pod_and_cluster	Error	4.61	test_vm_deployment_planner.py
test_05_deploy_vm_on_cluster_override_pod	Error	3.61	test_vm_deployment_planner.py
test_09_expunge_vm	Failure	424.88	test_vm_life_cycle.py
ContextSuite context=TestVmSnapshot>:teardown	Error	299.52	test_vm_snapshots.py
test_01_migrate_vm_strict_tags_success	Error	3607.74	test_vm_strict_host_tags.py
test_02_migrate_vm_strict_tags_failure	Error	4.65	test_vm_strict_host_tags.py
test_01_restore_vm_strict_tags_success	Error	20.56	test_vm_strict_host_tags.py
test_02_restore_vm_strict_tags_failure	Error	3607.25	test_vm_strict_host_tags.py
test_01_scale_vm_strict_tags_success	Error	23.20	test_vm_strict_host_tags.py
test_02_scale_vm_strict_tags_failure	Error	3606.02	test_vm_strict_host_tags.py
test_01_deploy_vm_on_specific_host_without_strict_tags	Error	27.80	test_vm_strict_host_tags.py
test_02_deploy_vm_on_any_host_without_strict_tags	Error	3605.43	test_vm_strict_host_tags.py
test_03_deploy_vm_on_specific_host_with_strict_tags_success	Error	3603.58	test_vm_strict_host_tags.py
test_04_deploy_vm_on_any_host_with_strict_tags_success	Error	3608.30	test_vm_strict_host_tags.py
test_04_deploy_vnf_appliance	Error	2022.66	test_vnf_templates.py
ContextSuite context=TestVnfTemplates>:teardown	Error	1817.67	test_vnf_templates.py
ContextSuite context=TestCreateVolume>:teardown	Error	2264.70	test_volumes.py
test_01_verify_ipv6_vpc	Error	3791.85	test_vpc_ipv6.py
test_01_verify_ipv6_vpc	Error	3792.19	test_vpc_ipv6.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL	Error	1924.77	test_vpc_redundant.py
test_02_redundant_VPC_default_routes	Error	1923.29	test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers	Error	1819.42	test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics	Error	1925.69	test_vpc_redundant.py
test_05_rvpc_multi_tiers	Error	1915.19	test_vpc_redundant.py
test_01_VPC_nics_after_destroy	Failure	5719.14	test_vpc_router_nics.py
test_01_redundant_vpc_site2site_vpn	Failure	1912.43	test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn	Error	1912.58	test_vpc_vpn.py
test_01_vpc_site2site_vpn_multiple_options	Error	2564.26	test_vpc_vpn.py
test_01_vpc_remote_access_vpn	Error	1937.20	test_vpc_vpn.py