Four environmental groups have now left the Government's Land and Water Forum (LaWF), leading to claims the group is losing its legitimacy.