Opened 10 years ago

Last modified 5 years ago

#4122 new bug

Copying huge dirs to image fails in populating image.

Reported by: tqh Owned by: bonefish
Priority: normal Milestone: R1
Component: Build System Version: R1/pre-alpha1
Keywords: Cc:
Blocked By: Blocking:
Has a Patch: no Platform: All

Description

Adding mozilla source to image, fails with weird errors:

BuildHaikuImage1 /dev/sda3 
/dev/sda3

Creating image ...
Writing boot code to "/dev/sda3" (partition offset: 120006835200 bytes, start offset = 0) ...
Populating image ...
could not create mutexError: Unexpected end of fs_shell reply. Was still expecting 4 bytes
Error: Failed to open connection to FS shell: Connection refused
Error: Failed to open connection to FS shell: Connection refused
Error: Failed to open connection to FS shell: Connection refused
Error: Failed to open connection to FS shell: Connection refused
...
...

I build from xubuntu-x64, sda3 is a 60GB partition and the added line to UserBuildConfig that fails the build below:

    CopyDirectoryToHaikuImage home : /home/frho/projects/mozilla : : -L ;

Removing it causes the build to succeed and I have another similar line for a smaller dir that doesn't cause this.

The mozilla dir was created by:

export CVSROOT=:pserver:anonymous@cvs-mirror.mozilla.org:/cvsroot
export MOZ_CO_PROJECT=browser
cvs co -r MOZILLA_1_8_BRANCH mozilla/client.mk
cd mozilla
make -f client.mk checkout

Change History (4)

comment:1 Changed 10 years ago by tqh

From Monni on IRC:

<Monni> fs_shell should be able to copy about 40960 files without bailing out...
<Monni> http://dev.haiku-os.org/browser/haiku/trunk/src/build/libroot/sem.cpp#L19 ... each file in copy process uses one semaphore

Number of files:

mozilla$ find ./ -type f | wc -l 
40457

So I guess it's that limit I hit, dunno if it's worth fixing. I can copy over just a zip instead. Unzipping in build gives same kind of failure btw.

comment:2 Changed 10 years ago by kaliber

Looks like that 40k semaphores is not enough - http://dev.haiku-os.org/changeset/26816

comment:3 Changed 9 years ago by michaelvoliveira

Thanks kaliber!

I resized to

'kSemaphoreCount = 51200;'

and all goes fine

comment:4 Changed 5 years ago by waddlesplash

Is this still a problem after the PM merge?

Note: See TracTickets for help on using tickets.