If you do decide to lease equipment, keep the term short two years is ideal. Try to negotiate a "modern equipment substitution clause" that lets you update or exchange your equipment so you don't end up paying for obsolete technology. And insist upon a cancellation clause that lets you pay a fee to cancel the lease. Note the cost of any cancellation penalty.
Additionally, if you think you might want to purchase the equipment after the term of the lease has ended, look for a lessor that offers an option to buy.
Once you've arranged for office equipment, you may turn your attention to provisioning the office with essential supplies. You can save money in this area, too though you need to look closely at prices before you spring for a bulk deal. Read our article Can You Save Money by Buying in Bulk? for quick tips on how to approach that purchase decision.