Copy task fails with internal error caused by file locking

swpalmer · May 20, 2012, 7:13pm

This is with 1.0-rc-3 The tasks in question look like this:

task prepareMyCopy(dependsOn: [generateFiles]) << {
 println "Copying from ${project.srcGeneratedDir}/java to ${project.pluginInstallDir}"
 println "Copying from ${project.srcGeneratedDir} excluding java/** to ${project.pluginInstallDir}/dev"
 tasks['myCopy'].into
project.pluginInstallDir
 tasks['myCopy'].from( "${project.srcGeneratedDir}/java" ) { include "*.jar" }
 tasks['myCopy'].from( "${project.srcGeneratedDir}" )
{
   into { "dev" }
  exclude "java/**"
 }
 tasks['myCopy'].from( "$docsGeneratedDir" )
{ into { "$docsGeneratedInstallDir" } }
}
task myCopy(type: Copy, dependsOn: prepareMyCopy)

The output is: :prepareMyCopy Copying from src-generated/java to C:\Users\the\correct\path Copying from src-generated excluding java/** to C:\Users\the\correct\path/dev

:myCopy

FAILURE: Build aborted because of an internal error.

What went wrong: Build aborted because of an unexpected internal error. Please file an issue at: http://forums.gradle.org.
Try: Run with --debug option to get additional debug info.
Exception is: org.gradle.api.UncheckedIOException: java.io.IOException: The process cannot access the file because another process has locked a por tion of the file

at org.gradle.util.hash.HashUtil.createHash(HashUtil.java:56)

at org.gradle.util.hash.HashUtil.createHash(HashUtil.java:34)

at org.gradle.api.internal.changedetection.DefaultHasher.hash(DefaultHasher.java:24)

at org.gradle.api.internal.changedetection.CachingHasher.hash(CachingHasher.java:42)

at org.gradle.api.internal.changedetection.DefaultFileSnapshotter.snapshot(DefaultFileSnapshotter.java:44)

at org.gradle.api.internal.changedetection.InputFilesChangedUpToDateRule.create(InputFilesChangedUpToDateRule.java:35)

at org.gradle.api.internal.changedetection.CompositeUpToDateRule.create(CompositeUpToDateRule.java:35)

at org.gradle.api.internal.changedetection.DefaultTaskArtifactStateRepository$HistoricExecution.calcCurrentState(DefaultTaskA rtifactStateRepository.java:80)

at org.gradle.api.internal.changedetection.DefaultTaskArtifactStateRepository$HistoricExecution.isUpToDate(DefaultTaskArtifac tStateRepository.java:88)

at org.gradle.api.internal.changedetection.DefaultTaskArtifactStateRepository$TaskArtifactStateImpl.isUpToDate(DefaultTaskArt ifactStateRepository.java:128)

at org.gradle.api.internal.changedetection.ShortCircuitTaskArtifactStateRepository$ShortCircuitArtifactState.isUpToDate(Short CircuitTaskArtifactStateRepository.java:77)

at org.gradle.api.internal.changedetection.FileCacheBroadcastTaskArtifactStateRepository$1.isUpToDate(FileCacheBroadcastTaskA rtifactStateRepository.java:37)

at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:44)

at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:57)

at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:41)

at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:51)

at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:52)

at org.gradle.api.internal.tasks.execution.ExecuteAtMostOnceTaskExecuter.execute(ExecuteAtMostOnceTaskExecuter.java:42)

at org.gradle.api.internal.AbstractTask.executeWithoutThrowingTaskFailure(AbstractTask.java:247)

at org.gradle.execution.DefaultTaskGraphExecuter.executeTask(DefaultTaskGraphExecuter.java:192)

at org.gradle.execution.DefaultTaskGraphExecuter.doExecute(DefaultTaskGraphExecuter.java:177)

at org.gradle.execution.DefaultTaskGraphExecuter.execute(DefaultTaskGraphExecuter.java:83)

at org.gradle.execution.SelectedTaskExecutionAction.execute(SelectedTaskExecutionAction.java:36)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:61)

at org.gradle.execution.DefaultBuildExecuter.access$200(DefaultBuildExecuter.java:23)

at org.gradle.execution.DefaultBuildExecuter$2.proceed(DefaultBuildExecuter.java:67)

at org.gradle.api.internal.changedetection.TaskCacheLockHandlingBuildExecuter$1.run(TaskCacheLockHandlingBuildExecuter.java:3 1)

at org.gradle.cache.internal.DefaultCacheAccess$1.create(DefaultCacheAccess.java:111)

at org.gradle.cache.internal.DefaultCacheAccess.useCache(DefaultCacheAccess.java:126)

at org.gradle.cache.internal.DefaultCacheAccess.useCache(DefaultCacheAccess.java:109)

at org.gradle.cache.internal.DefaultPersistentDirectoryStore.useCache(DefaultPersistentDirectoryStore.java:103)

at org.gradle.api.internal.changedetection.DefaultTaskArtifactStateCacheAccess.useCache(DefaultTaskArtifactStateCacheAccess.j ava:79)

at org.gradle.api.internal.changedetection.TaskCacheLockHandlingBuildExecuter.execute(TaskCacheLockHandlingBuildExecuter.java :29)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:61)

at org.gradle.execution.DefaultBuildExecuter.access$200(DefaultBuildExecuter.java:23)

at org.gradle.execution.DefaultBuildExecuter$2.proceed(DefaultBuildExecuter.java:67)

at org.gradle.execution.DryRunBuildExecutionAction.execute(DryRunBuildExecutionAction.java:32)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:61)

at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:54)

at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:155)

at org.gradle.initialization.DefaultGradleLauncher.doBuild(DefaultGradleLauncher.java:110)

at org.gradle.initialization.DefaultGradleLauncher.run(DefaultGradleLauncher.java:78)

at org.gradle.launcher.cli.ExecuteBuildAction.run(ExecuteBuildAction.java:38)

at org.gradle.launcher.daemon.protocol.Build.run(Build.java:68)

at org.gradle.launcher.daemon.protocol.Build.run(Build.java:64)

at org.gradle.launcher.daemon.server.exec.ExecuteBuild.doBuild(ExecuteBuild.java:45)

at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.WatchForDisconnection.execute(WatchForDisconnection.java:45)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.ResetDeprecationLogger.execute(ResetDeprecationLogger.java:24)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.StartStopIfBuildAndStop.execute(StartStopIfBuildAndStop.java:28)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.ReturnResult.execute(ReturnResult.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.ForwardClientInput$4.call(ForwardClientInput.java:116)

at org.gradle.launcher.daemon.server.exec.ForwardClientInput$4.call(ForwardClientInput.java:114)

at org.gradle.util.Swapper.swap(Swapper.java:38)

at org.gradle.launcher.daemon.server.exec.ForwardClientInput.execute(ForwardClientInput.java:114)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.LogToClient.doBuild(LogToClient.java:60)

at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment.doBuild(EstablishBuildEnvironment.java:61)

at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy.doBuild(StartBuildOrRespondWithBusy.java:49)

at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.HandleStop.execute(HandleStop.java:34)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.CatchAndForwardDaemonFailure.execute(CatchAndForwardDaemonFailure.java:32)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.HandleClientDisconnectBeforeSendingCommand.execute(HandleClientDisconnectBeforeSend ingCommand.java:21)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.StopConnectionAfterExecution.execute(StopConnectionAfterExecution.java:27)

at org.gradle.launcher.daemon.server.exec.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122)

at org.gradle.launcher.daemon.server.exec.DefaultDaemonCommandExecuter.executeCommand(DefaultDaemonCommandExecuter.java:55)

at org.gradle.launcher.daemon.server.Daemon$1$1.run(Daemon.java:123)

at org.gradle.messaging.concurrent.DefaultExecutorFactory$StoppableExecutorImpl$1.run(DefaultExecutorFactory.java:66)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)

at java.lang.Thread.run(Thread.java:722) Caused by: java.io.IOException: The process cannot access the file because another process has locked a portion of the file

at java.io.FileInputStream.readBytes(Native Method)

at java.io.FileInputStream.read(FileInputStream.java:220)

at org.gradle.util.hash.HashUtil.createHash(HashUtil.java:46)

… 83 more

BUILD FAILED

Total time: 2.513 secs

Peter_Niederwieser · May 20, 2012, 9:00pm

Not sure if it is related to the problem, but ‘prepareMyCopy’ looks very wrong. Tasks should be configured in the configuration phase, not in the execution phase. Try this:

task myCopy {
    into pluginInstallDir
    from("$srcGeneratedDir/java") {
       include "*.jar"
     }
    from(srcGeneratedDir) {
       into "dev"
      exclude "java/**"
    }
    from(docsGeneratedDir) {
       into docsGeneratedInstallDir
     }
 }

swpalmer · May 20, 2012, 10:19pm

The fact is that I don’t have the information for the copy task until it’s dependencies run. The name of the destination directory is not known until a file is read and parsed as part of the build.

I could call copy within the task I suppose, but my understanding was that I would then lose Gradle’s automatic “up-to-date” task skipping that I was hoping to leverage. For a simple file copy perhaps it doesn’t matter, but I thought this was a valid pattern for Gradle.

Is there some sort of “Gradle Best Practices” document somewhere that might document the patterns that I’m expected to use? The docs I find basically show a zillion ways to do things and I’m left wondering if there is a “right way”.

Peter_Niederwieser · May 20, 2012, 10:27pm

Does the file parsing have to be a task, or can it be done at configuration time? Anyway, you can defer evaluation of the paths passed to ‘from’ and ‘into’ by wrapping them with a closure. For example: ‘into { pluginInstallDir }’

A good way to get a solid understanding of Gradle is to study the user guide and the samples in the full Gradle distribution.

swpalmer · May 21, 2012, 2:54pm

I’ve addressed the issues with the configuration, but I still get the same error.

Peter_Niederwieser · May 21, 2012, 4:23pm

Maybe you have multiple daemons running. I suggest to check which process is locking the file.

swpalmer · May 21, 2012, 11:07pm

I rearranged some things and now I’m getting another error:

:copyPluginXml

FAILURE: Build aborted because of an internal error.

What went wrong: Build aborted because of an unexpected internal error. Please file an issue at: http://forums.gradle.org.
Try: Run with --debug option to get additional debug info.
Exception is: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean

at $Proxy31.isSatisfiedBy(Unknown Source)

at org.gradle.api.specs.OrSpec.isSatisfiedBy(OrSpec.java:39)

at org.gradle.api.specs.AndSpec.isSatisfiedBy(AndSpec.java:41)

at org.gradle.api.internal.file.collections.DirectoryFileTree.isAllowed(DirectoryFileTree.java:172)

at org.gradle.api.internal.file.collections.DirectoryFileTree.walkDir(DirectoryFileTree.java:149)

at org.gradle.api.internal.file.collections.DirectoryFileTree.visit(DirectoryFileTree.java:119)

at org.gradle.api.internal.file.collections.FileTreeAdapter.visit(FileTreeAdapter.java:96)

at org.gradle.api.internal.file.AbstractFileTree.isEmpty(AbstractFileTree.java:48)

at org.gradle.api.internal.file.CompositeFileCollection.isEmpty(CompositeFileCollection.java:57)

at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:36)

Peter_Niederwieser · May 22, 2012, 12:08am

Code, please.

swpalmer · May 22, 2012, 1:08am

These are the tasks involved… I moved the file parsing to a function that runs during config and sets up the project.ext.* variables. All of the files and folders print correctly for the initPluginInstallDir task… then I get the above error.

task initPluginInstallDir() << {
 if( project.buildPlatformEnabled ) {
  println( "Plugin Install Dir= "+project.pluginInstallDir);
  if( !pluginInstallDir )
   println "***** ProjectDir= $project.projectDir "
  project.pluginInstallDir.mkdirs();
 }
 println "copying from ${project.projectDir}"
 println "copying into ${project.pluginInstallDir}"
 println "copying include ${project.pluginXmlFile}"
}
  task copyPluginXml(type: Copy, dependsOn: initPluginInstallDir ) {
 from
  { project.projectDir }
 into
  { project.pluginInstallDir }
 include { project.pluginXmlFile }
}

:initPluginInstallDir Plugin Install Dir= C:\Users\me\dev\TheSDK\Plugins\ca.companyname.CommonTesting copying from C:\Users\me\dev\TheProject\ThePlugins\TESTING\CommonTesting copying into C:\Users\me\dev\TheSDK\Plugins\ca.companyname.CommonTesting copying include plugin.xml :copyPluginXml

FAILURE: Build aborted because of an internal error.

swpalmer · May 22, 2012, 1:14am

Here is the full stack trace. (I just re-ran it after deleting the .gradle folder to make sure it was a clean run.

:copyPluginXml

FAILURE: Build aborted because of an internal error.

What went wrong: Build aborted because of an unexpected internal error. Please file an issue at: http://forums.gradle.org.
Try: Run with --debug option to get additional debug info.
Exception is: java.lang.ClassCastException: java.lang.String cannot be cast to java.lang.Boolean