Visits to Simon Phillip's farm have dropped significantly after thousands of lorries were queuing near his farm, costing him more money to be open.