@mindmad I think I found a good dataset to work with rotated box.

http://www.robots.ox.ac.uk/~vgg/data/hands/

those hands has a rotation angle but still a rectangle bounding box just has a rotate.