Strong nonlinearity of plasmonic metamaterials can be designed near their effective plasma frequency in the epsilon-near-zero (ENZ) regime. We explore the realization of an all-optical modulator based on the Au nonlinearity using an ENZ cavity formed by a few Au nanorods inside a Si photonic wavegui