MiniBin is a free portable tool that allows you to access the recycle bin from the system tray.
How to use:
Just run the tool and it will sit in the system tray. Right-click on its icon to show the options. To empty the recycle bin, you can either double-click on its icon or select the Empty recycle bin option.
You can add it to the startup folder so that it runs every time Windows starts. If you delete the files, empty.ico and full.ico in the folder, you will get a different icon. You can also replace them with your own icons.