Apache Server

Trying to compile sysbench on a 64bit RedHat Enterprise Linux.

drv_mysql.c:35:19: error: mysql.h: No such file or directory
drv_mysql.c:36:26: error: mysqld_error.h: No such file or directory
drv_mysql.c: In function âmysql_drv_describeâ:
drv_mysql.c:284: error: âMYSQL_RESâ undeclared (first use in this function)
drv_mysql.c:284: error: (Each undeclared identifier is reported only once
drv_mysql.c:284: error: for each function it appears in.)
drv_mysql.c:284: error: âresâ undeclared (first use in this function)
drv_mysql.c:285: error: âMYSQL_ROWâ undeclared (first use in this function)
drv_mysql.c:285: error: expected â;â before ârowâ
drv_mysql.c:286: error: âMYSQL_FIELDâ undeclared (first use in this function)
drv_mysql.c:286: error: âfieldsâ undeclared (first use in this function)
drv_mysql.c:328: error: ârowâ undeclared (first use in this function)
drv_mysql.c: In function âmysql_drv_connectâ:
drv_mysql.c:360: error: âMYSQLâ undeclared (first use in this function)
drv_mysql.c:360: error: âconâ undeclared (first use in this function)
drv_mysql.c:366: error: expected expression before â)â token
drv_mysql.c:401: error: âMYSQL_VERSION_IDâ undeclared (first use in this function)
drv_mysql.c: In function âmysql_drv_disconnectâ:
drv_mysql.c:441: error: âMYSQLâ undeclared (first use in this function)
drv_mysql.c:441: error: âconâ undeclared (first use in this function)
drv_mysql.c: In function âmysql_drv_bind_paramâ:
drv_mysql.c:520: error: âMYSQLâ undeclared (first use in this function)
drv_mysql.c:520: error: âconâ undeclared (first use in this function)
drv_mysql.c:520: error: expected expression before â)â token
drv_mysql.c: In function âmysql_drv_queryâ:
drv_mysql.c:729: error: âMYSQLâ undeclared (first use in this function)
drv_mysql.c:729: error: âconâ undeclared (first use in this function)
drv_mysql.c:739: error: âER_LOCK_DEADLOCKâ undeclared (first use in this function)
drv_mysql.c:739: error: âER_LOCK_WAIT_TIMEOUTâ undeclared (first use in this function)
drv_mysql.c:739: error: âER_CHECKREADâ undeclared (first use in this function)
drv_mysql.c: In function âmysql_drv_store_resultsâ:
drv_mysql.c:789: error: âMYSQLâ undeclared (first use in this function)
drv_mysql.c:789: error: âconâ undeclared (first use in this function)
drv_mysql.c:790: error: âMYSQL_RESâ undeclared (first use in this function)
drv_mysql.c:790: error: âresâ undeclared (first use in this function)
drv_mysql.c:791: error: âMYSQL_ROWâ undeclared (first use in this function)
drv_mysql.c:791: error: expected â;â before ârowâ
drv_mysql.c:839: error: âER_LOCK_DEADLOCKâ undeclared (first use in this function)
drv_mysql.c:839: error: âER_LOCK_WAIT_TIMEOUTâ undeclared (first use in this function)
drv_mysql.c:855: error: ârowâ undeclared (first use in this function)
drv_mysql.c: In function âmysql_drv_free_resultsâ:
drv_mysql.c:879: error: âMYSQL_RESâ undeclared (first use in this function)
drv_mysql.c:879: error: expected expression before â)â token
make[3]: *** [libsbmysql_a-drv_mysql.o] Error 1
make[3]: Leaving directory `/tmp/sysbench-0.4.12/sysbench/drivers/mysql'
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory `/tmp/sysbench-0.4.12/sysbench/drivers'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/tmp/sysbench-0.4.12/sysbench'
make: *** [all-recursive] Error 1

I will describe here very quickly how to compile sysbench under CentOS. Probably it will work for other distributions if you have the same problem.

Here’s the error:

[... some lines removed ...]
/bin/sh ../libtool --tag=CC   --mode=link gcc -pthread -g -O2      -o sysbench sysbench.o sb_timer.o sb_options.o sb_logger.o db_driver.o tests/fileio/libsbfileio.a tests/threads/libsbthreads.a tests/memory/libsbmemory.a tests/cpu/libsbcpu.a tests/oltp/libsboltp.a tests/mutex/libsbmutex.a drivers/mysql/libsbmysql.a -L/usr/local/mysql/lib/ -lmysqlclient_r   -lrt -lm
../libtool: line 838: X--tag=CC: command not found
../libtool: line 871: libtool: ignoring unknown tag : command not found
../libtool: line 838: X--mode=link: command not found
../libtool: line 1004: *** Warning: inferring the mode of operation is deprecated.: command not found
../libtool: line 1005: *** Future versions of Libtool will require --mode=MODE be specified.: command not found
../libtool: line 2231: X-g: command not found
../libtool: line 2231: X-O2: command not found
../libtool: line 1951: X-L/usr/local/mysql/lib/: No such file or directory
../libtool: line 2400: Xsysbench: command not found
../libtool: line 2405: X: command not found
../libtool: line 2412: Xsysbench: command not found
../libtool: line 2420: mkdir /.libs: No such file or directory
../libtool: line 2547: X-lmysqlclient_r: command not found
../libtool: line 2547: X-lrt: command not found
../libtool: line 2547: X-lm: command not found
../libtool: line 2629: X-L/root/sysbench-0.4.12/sysbench: No such file or directory
../libtool: line 2547: X-lmysqlclient_r: command not found
../libtool: line 2547: X-lrt: command not found
../libtool: line 2547: X-lm: command not found
../libtool: line 2629: X-L/root/sysbench-0.4.12/sysbench: No such file or directory
../libtool: line 2547: X-lmysqlclient_r: command not found
../libtool: line 2547: X-lrt: command not found
../libtool: line 2547: X-lm: command not found
../libtool: line 5162: Xgcc -pthread "" "" -o @OUTPUT@ sysbench.o sb_timer.o sb_options.o sb_logger.o db_driver.o  tests/fileio/libsbfileio.a tests/threads/libsbthreads.a tests/memory/libsbmemory.a tests/cpu/libsbcpu.a tests/oltp/libsboltp.a tests/mutex/libsbmutex.a drivers/mysql/libsbmysql.a -L/root/sysbench-0.4.12/sysbench -lmysqlclient_r -lrt -lm: No such file or directory
../libtool: line 5163: Xgcc -pthread "" "" -o @OUTPUT@ sysbench.o sb_timer.o sb_options.o sb_logger.o db_driver.o  tests/fileio/libsbfileio.a tests/threads/libsbthreads.a tests/memory/libsbmemory.a tests/cpu/libsbcpu.a tests/oltp/libsboltp.a tests/mutex/libsbmutex.a drivers/mysql/libsbmysql.a -L/root/sysbench-0.4.12/sysbench -lmysqlclient_r -lrt -lm: No such file or directory
../libtool: line 5168: X: command not found
../libtool: line 5172: : command not found

There are some libtool errors, we will recreate all automake utilities with autogen:

$ ./autogen.sh

If you don’t get any error, run:

./configure
make
make install

All set, test it by running:

 sysbench --test=cpu --cpu-max-prime=20000 run

In Linux machines, the “top” command is one of the most frequently used commands to get information about your machine performance. It gives you information about your CPU usage, RAM usage and the load average of the machine. The load average represents the average system load over a period of time and in normal cases it should be under 1.0. You can get the load average by typing “top” or “uptime” in your shell and it will give you 3 numbers which represent the load in the last 1, 5 and 15 minutes. An IDLE CPU will result in 0 load, while a load of 2.5 represents that the CPU was overloaded by 150% in the last minute.

How do I diagnose the load average?

You can know whether your computer is dealing with a heavy load simply by noticing that it is slow and the response time is more usual. To find out what is causing the problem, you have to type the “top” command in your shell and focus on the first 3 lines of the output. The important thing for us in the 1st line is the load average; notice the 3 numbers. If they are between 0 and 5, then your computer is fine. If they are between 5 and 10, this is a high load, but if they are more than 10, then you have some problems that need more investigation. If your load is more than 10, you should now take a look at the 3rd line “cpu(s):” : this is an ideal view of the 3rd line in the “top” command Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st

1- check the the first 2 numbers as they represent the percentage of the total time the CPU is spending to process stuff. If they are always 99-100%, you have to upgrade your CPU.

2- check the 5th number as it represents the percentage of time a CPU takes in waiting for an I/O. If the number is above 90%, this means that the CPU is spending a lot of time waiting for I/O. This could be due to an HDD problem or a Network problem or an application trying to access data at a rate higher than what the network or HDD are designed for. To know what process is causing this problem, write this command in your shell: ” ps faux”. It will list all the running processes in your system. Have a look at the stat column and you should see letters like these: R = running S = sleeping D = waiting for something, so look for any process that has D and you can check it and see what is the problem with this process.

Sessions are a standard feature of web application servers, however the interoperability of sessions between different web application servers is generally limited. This talk introduces the mod_session modules collection in httpd v2.4 that attempts to create a unified session for httpd and web application servers. It is aimed at people interested in practical single sign-on, as well as for people trying to bring sanity to mixed architecture environments. We will start by introducing some of the history behind mod_session, why it was developed, and what problems mod_session is trying to solve. We will then continue by introducing what a session is within mod_session, and cover some of the ways in which a session might be created and where a session might be stored. We will then move on to cover the options available for securing sessions using encryption, and handling sessions on highly loaded or distributed environments. The focus will then shift to web applications and web application servers, and how they might read from and write to a session without having to care how the session is implemented or configured. We will then show some examples of how sessions might be used in practice, with examples in secure and in highly loaded environments. The talk will conclude by looking at some of the future development planned for mod_session, and how people can get involved in further development before httpd v2.4 is finally released.

ApacheCon Europe 2009

Reducing file sizes and removing unnecessary HTTP requests made to your server can not only reduce the tole on your bandwidth but also improve the user experience when using your site. Sites laden with with large high resolution images and complex flash animations are becoming common place on the world wide web as connection speeds continue to increase. Whilst this bring many benefits it also takes any attention away from developers optimizing their sites to provide the best possible service.

Web professionals have a tendency to assume that their users are using a 10Mb connection and will be able to download their 6MB flash intro video in mere seconds. Sadly this is not the case. Whether its because the user is running downloads, is in an area with bad signal quality or just has not yet upgraded to a fast modern connection there are various reasons why a person may be browsing the internet on a slow connection. The last thing as developers we want to do to that person is exclude them just because their connection is not as fast as it could be. That is why I have written these few quick easy tips on how to streamline your site using Apaches built in features to ensure that users access your site as quickly and easily as possible. These tips are all based on guidelines present by yahoo and implementing them all will give you a Y!Slow score of A, making it apparent that you care about users with slower connections.

Optimizing with the .htaccess file

There are a few simple lines which you can add to your .htaccess file on your site which will set Apache up to use these bandwidth saving features. If you do not have a .htaccess file at the moment or you are unsure of what it is simply create a text file called “.htaccess” (note no file extension) in the root of your site and Apache should detect it automatically. If this is not the case contact your system administrator for further details.

Header unset ETag
FileETag None

The above 2 lines when added to your .htaccess file will stop Apache sending ETags out with assets from your site. The ETag is used to track changes to a file on the server so they can be compared to the cache of the users web browser. Removing the ETags forces the browser to compare date changed values instead which is a much more accurate method of tracking changes to content.

Header set Expires "Thu, 15 Apr 2012 20:00:00 GMT"

The above lines dictate to the server to send out expiry headers with any files with the extensions dictated in the first line. By setting those expiry headers far in the future it stops the users browser from request these assets again if they are in the cache and therefore stops unnecessary HTTP requests. As a rule of thumb I would recommend not applying this rule to js and css files as these are most likely to change and could damage the user experience if they are changed but not re-downloaded. If you make any big changes to your site I would recommend disabling these few lines (by putting a # at the start of each line) so that your changes can be properly circulated until browser caches expire.

SetOutPutFilter DEFLATE

This last .htaccess option uses the Apache module DEFLATE to compress all text based output. Using this option means all files with a text mime-type are compressed using gzip and can be reduced in size by up to 80%. This option is vitally important, especially for very text heavy sites as it massively decreases the amount which a user has to download when accessing your site.

All the options stated above are all entirely server side changes and will not effect the user in any way other than quicker download times. All internet browsers are compatible with these modifications.

Minify your JavaScript on the Fly

Adding functionality to your site using JavaScript can be great but when you have finished you often end up with massive JavaScript files which are full of needless comments and white space. To combat this a man named Douglas Crockford wrote a small app called jsmin which strips out those unnecessary elements without damaging the file. Crockfords app is now available in many forms such as a windows .exe programs or Python, Ruby, Perl scripts which allow you to minify your code prior to run time. However, we are going to use the PHP version of jsmin to minify our JavaScript on the fly meaning we can keep our scripts in their true form without the user seeing them.

First you will need to download the PHP version of jsmin from Douglas Crockfords website (http://www.crockford.com/javascript/jsmin.html). Then you will need to create a small PHP script which will be referenced by the page as a JavaScript file when infact its a PHP script masquerading as a JavaScript file. In that file you will need to first send a header indicating the file is JavaScript, then include the jsmin library before finally echoing out the minified JavaScript. Here is an example:

Now simply point your page(s) to use this new script instead of page_script_full.js and you will make a massive saving on transfer times.