The Red Rooks have been seen searching the area, which leads me to believe that something is there. If it is a fort, think of the reasures that might still be hidden inside!
Ilessan Tower is located east of the northern wayshrine in Daggerfall, Glenumbra.