Must say I am amazed with the Agents attitude,Probably your Solictor is doing his job to protect you from the many pit falls in buying property in Spain,more than likely asking questions that the Agent doesnt want to answer, as it will jeopardise the sale.
If you have paid a deposit ,i would try to retrieve it and tell the agent where to go,dont be pushed into anything that he wants to rush through,and of course name and shame him to make other people aware of his dodgy dealings.
You may not get the house you want ,but look around locally and you will find plenty up for sale,and dont forget it is a buyers market