Strange *-tests.jar resolution issue when using mavenLocal()

[jamesdh (James Hardwick)]

We’re in the process of upgrading hadoop 2.6.0 to hadoop 2.7.1 for one of our gradle projects. Said project is depended on by another grails project.

We use mavenLocal() for both projects during development. When trying to upgrade hadoop, we’re experiencing a weird issue where once we run the grails project and it resolves all dependencies (including those from the gradle project it is dependent on) into the local maven repo, the gradle project then breaks while it tries to (incorrectly?) resolve a *-tests.jar of one of our dependencies out of mavenLocal (specifically zookeeper:3.4.6). This despite the fact that both versions of hadoop use the same version of zookeeper. Yet we never experienced this issue with hadoop 2.6.0.

Prior to resolving this via grails and hence caching the artifact in maven locally, the gradle project works fine, resolving the dependency into it’s own local artifact cache. But as soon as you run grails and get the zookeeper dependency into the local maven repo, the use of mavenLocal() causes the gradle project to fail.

I’ve created two bare projects - one gradle, one grails, that reproduces this at https://github.com/entagen/ResolutionIssue. Simply doing a grailsw compile in the grails project and then gradlew dependencies in the gradle project should suffice to reproduce this. Both projects have matching wrappers with what we are using internally. You’ll see that if you switch the dependencies in the gradle project to the 2.6.0 ones that are commented out, everything works fine.

What am I missing?

[jamesdh (James Hardwick)]

A bit more info. Both Hadoop 2.6.0 and 2.7.1 have this in their hadoop-common POM:

<dependency>
  <groupId>org.apache.zookeeper</groupId>
  <artifactId>zookeeper</artifactId>
  <type>test-jar</type>
  <scope>test</scope>
</dependency>

Yet again, with 2.7.1, resolving compile time dependencies results in the following if zookeeper exists in my local maven repository:

> Could not resolve all dependencies for configuration ':compile'.
    > Could not find zookeeper-tests.jar (org.apache.zookeeper:zookeeper:3.4.6).
      Searched in the following locations:
            file:/Users/James/.m2/repository/org/apache/zookeeper/zookeeper/3.4.6/zookeeper-3.4.6-tests.jar

[jamesdh (James Hardwick)]

FWIW, what I’m experiencing seems to essentially be the same as this:

Gradle fails to download dependencies if not present in mavenLocal()

Hi, Let me start by admitting that I’m an absolute newbie to Gradle; in fact, I started using it only as part of learning “Cascading” which uses Gradle for build. When I’m trying to build, I’m getting the following exception. It appears that the dependency is not present in the local Maven repo and Gradle, for some reason, fails instead of downloading it. Option --refresh-dependencies does not help. I found two workarounds 1) Put mavenCentral() before mavenLocal() in the build file, or 2) Dele…

https://issues.gradle.org/browse/GRADLE-2709

The weird thing is how it does/doesnt work depending on the version of the parent dependency I’m trying to resolve, and I can’t find what differs between the two versions that would now cause this.

[jamesdh (James Hardwick)]

For future reference, the solution was to exclude the module that had the related *-tests.jar and explicitly include it but with the @jar extension, which apparently causes resolution to exclude the tests jars.