What does this PR do ?

e.g., for MLA (DeepSeek V3 arch models), we should also be able to support all linear layers LoRA via setting target_modules as: ["linear_kv_down_proj","linear_kv_up_proj","linear_q_down_proj","linear_q_up_proj","linear_q_proj","linear_proj","linear_fc1_up","linear_fc1_gate","linear_fc2"]

Changelog

• Not hard coding the possible supported target_modules and using endswith to matching target module names instead.

GitHub Actions CI

See the CI sectionin the Contributing doc for how to trigger the CI. A Nvidia developer will need to approve and trigger the CI for external contributors.

Before your PR is "Ready for review"

Pre checks:

• Make sure you read and followed Contributor guidelines
• Did you write any new necessary tests?
• Did you add or update any necessary documentation?
• Does the PR affect components that are optional to install? (Ex: Numba, Pynini, Apex etc)
  • Reviewer: Does the PR have correct import guards for all optional libraries?

If you haven't finished some of the above items you can still open "Draft" PR.

Additional Information

• Related to # (issue)

_{✨ Presented to you with Mind Lab - A Lab for Experiential Intelligence.}