I did a bit of spring cleaning and found some solutions to a course using exercises from the book The Elements of Statistical Learning by Trevor Hastie, Robert Tibshirani, Jerome H. Friedman. As the exercises are tricky, somewhat unclear in their formulation and no solutions seem to be available for purchase I decided to put up mine. However, bear in mind these are only suggested solutions and there might be errors. Further on, if this is your homework please do not use them to cheat, you just are cheating yourself. Progress is no free lunch.