Will be my first post, so greetings from the warm Indonesia.
I am converting a hybrid ant-maven build and now in the phase of ironing out the result.
One problem (well, at least to me it is a ‘problem’) that I have is that it still took too long for the war task to complete.
Eventhough there is only 1 JSP changed, and the result would be an exploded directory, it still take 16 seconds to complete.
In my mind it should be a lot faster since what the war plugin needs to do is sync that single file instead of doing whatever else it is doing.
Any hint on where I should look next?
P.S. not looking for being spoonfed just a hint on where to look is fine. However I will not reject should somebody care to explain in detail.
16s for packaging a war seems like a lot indeed. keep in mind that the war task is not synching a directory, but building an archive. Can you check how big your war got? seems like it’s packaging a lot of stuff.
are you maybe using a network share that slows down your file operations?
It is indeed a big war; packs a lot of stuff.
The war archive is 200mb-ish, exploded war exceeds 300mb. Hundreds of JSPs, javascripts and web assets to be packaged.
Yes I can somehow sense that it is rebuilding the whole package instead of syncing.
So what I have in mind:
modularize my project more such that portions of the web asset can be cached (i am speculating here, not sure if this makes sense at all )
create my own logic to deploy exploded war for development purpose.
I think the second option is my best bet, no?
In case I am going that route, what do I need to know to have up-to-date checking work?
You can reuse the spec of the war task to create an exploded version instead, without first packing it. Packing is not incremental, which would explain the long times you see. Still, 15s for 200MB sounds like a slow file system, so something you might want to look into.
task explodedWar(type: Sync) {
into whereverYouWantItToBe
with war
}
Using Sync instead of Copy does not help.
It still take long to synchronize exploded folder with source.
The project do have non-conventional directory structure, and what I do to assemble to complete war is this,
As for my workstation’s I/O subsystem, I believe it is fine.
My laptop have decent SSD, which Crystal Disk Mark test result shows:
4k block random read with 4 thread, 32 queue: 365MB/s
4k block random write with 4 thread, 32 queue: 300MB/s
4k random read single thread: 23MB/s
4k random write single thread: 100MB/s
Test file was 4GB (although i dont think test file size matters since SSD have no concept of cluster proximity).
I’m on NTFS.
My workstation running Windows 10 Enterprise.
Do you really think that the filesystem make that much difference?
If you dont mind me asking, according to your experience how much time does it take to build a 200-300mB war (consisting of hundreds of web assets, 30-40 dependencies jar, and hundreds of classes) and what filesystem are you on?
Absolutely, NTFS is slow with many small files. I don’t have a direct comparison project to measure against right now, but I’ve generally seen large copy tasks being 5-10 times faster on my Mac than on my previous Windows machine.
just a hint on where to look is fine. However I will not reject should somebody care to explain in detail.
)