clab / clab/dynet

Feature Request: Add MKL-DNN to speed up dynet conv2d on CPU

Open
#1,337 5 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
3.4k
Forks
701
PR merge metrics
No merged PRs in 30d

Description

Dynet is a great deep learning framework. However, it's conv2d implementation is very slow on CPU, about 6 times slower than PyTorch on a 6700K-CPU machine. Recently Intel released the [MKL-DNN](https://github.com/intel/mkl-dnn) library which can significantly improve Conv2d, Relu, BatchNorm etc performance on Intel CPU platform. For those of us who don`t have GPU, it will be a good News to have it in Dynet.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue identifies Dynet's CPU conv2d implementation and MKL-DNN as the starting points; review MKL-DNN support for Conv2d, Relu, and BatchNorm. Compare CPU conv2d with the current implementation on the stated 6700K setup, but note that the issue names no files or tests and does not define a completion criterion.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
machine-learning, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.