You are on the right track! You can specify the equivalent to your -D argument in ~/$GRADLE_USER_HOME/gradle.properties like the following example.
systemProp.javax.net.ssl.trustStore=“/home/user/project/gradle/keystore”
systemProp.javax.net.ssl.trustStorePassword=xyzABC