unimplemented functions

[kaliber]

I wrote a buggy script which detects declared but not implemented functions (symbols) in Haiku. It found (not a full list yet):

stdio.h:
	_ftell

setjmp.h:
	_setjmp

nl_types.h:
	catclose
	catgets
	catopen

math.h:
	__fpclassifyl
	__signbitf
	gamma_r
	gammaf_r

iconv.h:
	functions implemented in libtextencoding?

search.h:
	hcreate
	hdestroy
	hsearch
	remque

stdlib.h:
	random_r
	setstate_r
	srandom_r

wctype.h:
	towctrans

wchar.h:
	fgetws
	getwchar
	wcsftime

libio.h:
	_IO_feof_unlocked
	_IO_ferror_unlocked
	_IO_getc_unlocked ?
	_IO_peekc_unlocked ?
	_IO_putc_unlocked ?

[andreasf]

#2564 was about __signbitf

[korli]

added remque in hrev27422

[scottmc]

This one is blocking ​HaikuPorts Ticket #70, which affects building the CVS version of CVS. So until the libio.h functions are implemented we won't have a Haiku native CVS. Good news is that the BeOS CVS has been working ok as far as I can tell.

[umccullough]

Is it true that no native version can be built?

It seems the CVS here:

​http://haiku-files.org/files/optional-packages/

May be a native version already. At least, it seems to be built for /boot/common already.

IIRC, this was provided by stippi, but I can't confirm that.

[scottmc]

In that zip file the .OptionalPackageDescription said it was the BeOS version...
It's possible to build 1.12.13 with a bit of hacking along the way, which is what I'll probably do. But no use in sending in patches for that as the cvs version of cvs has dropped a lot of files some of which need to be patched on 1.12.13.
Andreas got it mosted working:
​http://ports.haiku-files.org/wiki/dev-util/cvs
I'll take another look at in the next few days here. But the cvs version of cvs is stuck util the functions actually exist.

[axeld]

libio.h is not a POSIX header, and the functionality doesn't seem to be standardized anywhere. If CVS is using it now for whatever reason (poor maintainer IMO), I would think we could easily live with an older version of it.

[scottmc]

@Kaliber
Can you post your buggy script here? Might be useful in rechecking these from time to time.

[harsha]

so far found the following functions already in haiku
math.h:

fpclassifyl -> system/libroot/posix/glibc/arch/x86/s_fpclassifyl.c

signbitf -> system/libroot/posix/glibc/arch/generic/s_signbitf.c

gamma_r -> system/libroot/posix/glibc/arch/generic/e_gamma_r.c

gammaf_r -> /system/libroot/posix/glibc/arch/generic/e_lgamma_r.c

wctype.h

towctrans -> system/libroot/posix/glibc/wctype/towctrans.c

I added the following functions
nl_types.h:

catclose

catgets

catopen

when i am building they are not linking . can anybody tell me what i am missing. I added the files under glibc and doing a normal build.
and this is what my target vmware image contains

$>strings Haiku-IDE_0-1.vmdk | grep "catclose"

/* SYSCALLS.c:385:NC */ extern int catclose (nl_catd);

[kaliber]

scripts to detect unimplemented functions

[kaliber]

Here is updated report (hrev30960). It covers everything except compatibility headers (bsd):

stdio.h:
	_ftell (_IO_ftell)

math.h:
	gammaf_r (__ieee754_gammaf_r)
	gamma_r (__ieee754_gamma_r)
	lgammal (__ieee754_lgammal_r)

search.h:
	hcreate
	hdestroy
	hsearch

iconv.h:
	iconv (libiconv)
	iconv_close (libiconv_close) 
	iconv_open (libiconv_open)

dirent.h:
	seekdir
	telldir

setjmp.h:
	_setjmp (setjmp)

wchar.h:
	wcsftime

Please close the ticket #2702

[scottmc]

Replying to scottmc:

This one is blocking ​HaikuPorts Ticket #70, which affects building the CVS version of CVS. So until the libio.h functions are implemented we won't have a Haiku native CVS. Good news is that the BeOS CVS has been working ok as far as I can tell.

HaikuPorts ticket 70 has been closed as fixed.

[michaelvoliveira]

some news for _setjmp?

Premake need that

[michaelvoliveira]

Ignore it

I already manage the problem

[scottmc]

Replying to kaliber:

Here is updated report (hrev30960). It covers everything except compatibility headers (bsd):

Kaliber, can you rerun your check on these so we can see where it stands now?

[kaliber]

Still missing hrev39652:

math.h:
	lgammal
	gamma_r
	gammaf_r

search.h:
	hcreate
	hdestroy
	hsearch

[korli]

The problem I saw this week is that our posix headers might be incomplete, so checking for missing implementations is not enough.

[bonefish]

Replying to korli:

The problem I saw this week is that our posix headers might be incomplete, so checking for missing implementations is not enough.

Yep. This should really be approached thoroughly:

1. Check against the POSIX specs which headers should be there and make a complete list.
2. For each header compare what the specs require with what we have and note all differences (in tickets or in the wiki).

Then things can be worked on individually and crossed off the list.

The script is nice to see, if we have forgotten to implement something, though.

[deangenovski]

I have made a complete list with functions and other parts missing. Here is the link:
​https://docs.google.com/viewer?a=v&pid=explorer&chrome=true&srcid=0BwL4-uh5Btc_YmJlZjBkY2QtZDBlMy00ZDNiLTgwMjMtZTg0MTAzMjJkNTZi&hl=en&authkey=CMKEhPwF

[scottmc]

changed the quotes to the regular quote character, should be easier to read now.

[michaelvoliveira]

FILE is needed for the OpenAL port

could help a lot if Haiku implement that

[umccullough]

FILE appears to be defined here:

​http://dev.haiku-os.org/browser/haiku/trunk/headers/posix/stdio_pre.h

which is included in stdio.h here:

​http://dev.haiku-os.org/browser/haiku/trunk/headers/posix/stdio.h#L57

[umccullough]

Futhermore, it would seem that stdarg.h and stddef.h are already part of GCC's included headers, and thus we do not provide separate versions of these (they should get installed into the appropriate gcc header directory when the development tools are added to the haiku image):

​http://dev.haiku-os.org/browser/buildtools/trunk/gcc/gcc/ginclude

[deangenovski]

That's a compare list aginst posix specifications.

[umccullough]

You can probably remove the "can't find FILE" part as well.

it's defined in stdio.h (via the include of stdio_pre.h) - as type _IO_FILE - which is defined in libio.h here:

​http://dev.haiku-os.org/browser/haiku/trunk/headers/posix/libio.h#L117

[jprostko]

I just wanted to mention that several students for Google Code-in have taken on this task to complete. Depending on how things go, I'll post patches here for review prior to committing to trunk.

[bonefish]

Replying to jprostko:

I just wanted to mention that several students for Google Code-in have taken on this task to complete. Depending on how things go, I'll post patches here for review prior to committing to trunk.

Great! Please take care not to add/change stuff that isn't actually supported by the implementation.

deangenovski, thanks, that's a start. scottmc and umccullough are right, though: Some headers don't define all the stuff required by POSIX themselves, but include other headers that do (which is just fine), and some headers are provided by the compiler. Moreover, POSIX requires dozens of headers of which Haiku is definitely missing quite a few, and likely has a good deal of headers that don't fully conform to the specification.

I think it would be best to organize the information either in a wiki or in hierarchical tickets. I.e. one overview section/ticket listing all the non-conforming/missing (and maybe even the conforming) headers, for each header a section/ticket listing the defects in the header, and per defect (or group of defects) a subsection/ticket detailing on them. As written earlier IMO the best approach is to compile a complete list of headers first and then iterate through them and add details. The second step can be parallelized wonderfully.

[scottmc]

We've broken #4947 down into a few GCI tasks to have students research and provide a list of what's missing. From those results we will then open/update trac tickets to take on each of the missing parts. There's also some other tasks being worked on to implement some of the missing functions. A wiki checkoff list would be a good thing to add as well.

[richienyhus]

Lastest info

[bonefish]

The list is largely incorrect. Haiku provides all of the functionality listed under <signal.h>, <sys/select.h>, <sys/stat.h>, <sys/times.h>, <time.h>, <unistd.h>. That's just what I can tell off the top of my head. I haven't checked the other stuff.

[richienyhus]

Och, although not my fault as it its the work of a GCI2012 student.