Westbury lost Matt Jones to a serious knee ligament injury in a first half that ended goalless but the green and whites took charge in the second period, going two up through goals from Joe Moloney and Dean Wheeler.
O's defender Jordan Greenwood pulled a goal back later in the game but despite several chances for either side, Westbury took all three points back to Wiltshire with them.