We have created docker distributions using https://github.com/marketplace/actions/build-and-push-docker-images. All the OS that supports docker should also support our docker based agent.
This is applicable on both x86 & ARM based machines, as we are using multi-platform builds.Here is a list of Tested AWS EC2 instances.