Does relax support dynamic graph inferring on GPU now?

Yes, checkout https://github.com/mlc-ai/mlc-llm which uses relax and relies on dynamic shape for LLMs