On a normal opencv build , there are lot of unused link time dependencies as reported by ldd -u -r
The most problematic are libGL and QT5 libs because they will trigger lot of dependencies for a opencv-core (hence not really "core" anymore).
The workaround is to use -Wl,--as-needed as CFLAGS, but best is to have the issue fixed as source.

Here a full report of the libs I'm currently bundling as a fedora opencv-core package:

libopencv_core.so.3.1.0
Unused direct dependencies:
libGLU.so.1
libGL.so.1

libopencv_cvv.so.3.1.0
Unused direct dependencies:
libopencv_features2d.so.3.1
/lib64/libdl.so.2
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_flann.so.3.1
libopencv_ml.so.3.1
libopencv_highgui.so.3.1
libopencv_videoio.so.3.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1
libQt5Widgets.so.5
libQt5Gui.so.5
libQt5Core.so.5

libopencv_features2d.so.3.1.0
Unused direct dependencies:
libopencv_flann.so.3.1
libopencv_ml.so.3.1
libopencv_highgui.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_videoio.so.3.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_flann.so.3.1.0
Unused direct dependencies:
libopencv_core.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1

libopencv_highgui.so.3.1.0
Unused direct dependencies:
libopencv_videoio.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libgstbase-1.0.so.0
libgstreamer-1.0.so.0
/lib64/libgobject-2.0.so.0
/lib64/libglib-2.0.so.0
libgstvideo-1.0.so.0
libgstapp-1.0.so.0
libgstriff-1.0.so.0
libgstpbutils-1.0.so.0
libunicap.so.2
libucil.so.2
libpangoft2-1.0.so.0
libpango-1.0.so.0
libfontconfig.so.1
/lib64/libfreetype.so.6
libdc1394.so.22
libv4l1.so.0
libv4l2.so.0
libgphoto2.so.6
libgphoto2_port.so.12
libQt5Test.so.5
libQt5Concurrent.so.5
libQt5OpenGL.so.5
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1
libQt5Widgets.so.5
libQt5Gui.so.5
libQt5Core.so.5

libopencv_imgcodecs.so.3.1.0
Unused direct dependencies:
libopencv_imgproc.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
/lib64/libz.so.1
libjpeg.so.62
libwebp.so.6
libtiff.so.5
libjasper.so.1
libImath-2_2.so.12
libIlmImf-2_2.so.22
libIex-2_2.so.12
libHalf.so.12
libIlmThread-2_2.so.12
libgdal.so.20
libopencv_core.so.3.1

libopencv_imgproc.so.3.1.0
Unused direct dependencies:
libopencv_core.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1

libopencv_ml.so.3.1.0
Unused direct dependencies:
libopencv_core.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1

libopencv_objdetect.so.3.1.0
Unused direct dependencies:
libopencv_ml.so.3.1
libopencv_highgui.so.3.1
/lib64/libdl.so.2
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_videoio.so.3.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_photo.so.3.1.0
Unused direct dependencies:
libopencv_imgproc.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_core.so.3.1

libopencv_shape.so.3.1.0
Unused direct dependencies:
libopencv_video.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_stitching.so.3.1.0
Unused direct dependencies:
libopencv_objdetect.so.3.1
libopencv_calib3d.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_features2d.so.3.1
libopencv_flann.so.3.1
libopencv_ml.so.3.1
libopencv_highgui.so.3.1
libopencv_videoio.so.3.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_superres.so.3.1.0
Unused direct dependencies:
libopencv_video.so.3.1
libopencv_videoio.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_videoio.so.3.1.0
Unused direct dependencies:
libopencv_imgcodecs.so.3.1
/lib64/libdl.so.2
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libgstbase-1.0.so.0
libgstreamer-1.0.so.0
libgstvideo-1.0.so.0
libgstapp-1.0.so.0
libgstriff-1.0.so.0
libgstpbutils-1.0.so.0
libunicap.so.2
libucil.so.2
libpangoft2-1.0.so.0
libpango-1.0.so.0
libfontconfig.so.1
/lib64/libfreetype.so.6
libdc1394.so.22
libv4l1.so.0
libv4l2.so.0
libgphoto2.so.6
libgphoto2_port.so.12
libopencv_imgproc.so.3.1
libopencv_core.so.3.1

libopencv_video.so.3.1.0
Unused direct dependencies:
libopencv_imgproc.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_core.so.3.1

libopencv_videostab.so.3.1.0
Unused direct dependencies:
libopencv_photo.so.3.1
libopencv_video.so.3.1
libopencv_calib3d.so.3.1
/lib64/libdl.so.2
/lib64/libpthread.so.0
/lib64/librt.so.1
libGLU.so.1
libGL.so.1
libopencv_features2d.so.3.1
libopencv_flann.so.3.1
libopencv_ml.so.3.1
libopencv_highgui.so.3.1
libopencv_videoio.so.3.1
libopencv_imgcodecs.so.3.1
libopencv_imgproc.so.3.1
libopencv_core.so.3.1