This amazing article helps you with the improving speed of the WordPress easily with the header.php and .htaccess: http://wp.tutsplus.com/tutorials/hosting/optimizing-wordpress-loading-speed-with-header-php-htaccess/
And also you can try these techniques: http://wp.tutsplus.com/tutorials/the-ultimate-quickstart-guide-to-speeding-up-your-wordpress-site/