We investigated the strength of acousto-optical (AO) interaction in one-dimensional fish-bone silicon nanobeam computationally. The structure can generate phononic and photonic band gaps simultaneously. We use defect cavity optical mode and slow light mode to interact with acoustic defect modes. The AO coupling rates are obtained by adding the optical frequency shifts, which result from photo-elastic effect and moving-boundary effect disturbances. The AO coupling rates are strongly dependent on the overlap of acoustic and optical mode distribution. The strength of AO interaction can be enhanced by choosing certain acoustic defect modes that are formed by the stretching of wings and that overlap significantly with optical fields.