Guess what, buildSrc approach actually works!
gradle-docker-plugin version is really upgraded when checking the URL in classloader I can see class is taken from the artifact with version 3.2.4.
Lessons learned: Classloader is your friend