Lib Dems under fire as Greens gather for annual conference