Yes, but check the Product Specific Terms and Conditions for the relevant minimum deposit. There is also a minimum amount for any subsequent deposits.
The minimum deposit for Access Accounts is £1.
The minimum deposit for Fixed Rate Bonds, Cash ISAs and Notice Accounts is £1,000.