An improved crowdsourcing based evaluation technique for word embedding methods

Farhana Ferdousi Liza; Marek Grzes

An improved crowdsourcing based evaluation technique for word embedding methods

Farhana Ferdousi Liza, Marek Grzes

School of Computing Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

In this proposal track paper, we have presented a crowdsourcing-based word embedding evaluation technique that will be more reliable and linguistically justified. The method is designed for intrinsic evaluation and extends the approach proposed in (Schnabel et al., 2015). Our improved evaluation technique captures word relatedness based on the word context.

Original language	English
Title of host publication	Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016
Publisher	Association for Computational Linguistics (ACL)
Pages	55-61
Number of pages	7
ISBN (Electronic)	9781945626142
Publication status	Published - 2016
Event	1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Berlin, Germany Duration: 7 Aug 2016 → …

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016
Country/Territory	Germany
City	Berlin
Period	7/08/16 → …

Cite this

Liza, F. F., & Grzes, M. (2016). An improved crowdsourcing based evaluation technique for word embedding methods. In Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 (pp. 55-61). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL).

Liza, Farhana Ferdousi ; Grzes, Marek. / An improved crowdsourcing based evaluation technique for word embedding methods. Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016. Association for Computational Linguistics (ACL), 2016. pp. 55-61 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

@inproceedings{87e086d5ee904ff49038f8a661615f57,

title = "An improved crowdsourcing based evaluation technique for word embedding methods",

abstract = "In this proposal track paper, we have presented a crowdsourcing-based word embedding evaluation technique that will be more reliable and linguistically justified. The method is designed for intrinsic evaluation and extends the approach proposed in (Schnabel et al., 2015). Our improved evaluation technique captures word relatedness based on the word context.",

author = "Liza, {Farhana Ferdousi} and Marek Grzes",

note = "Publisher Copyright: {\textcopyright} 2016 Proceedings of the Annual Meeting of the Association for Computational Linguistics. All Rights Reserved.; 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 ; Conference date: 07-08-2016",

year = "2016",

language = "English",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics (ACL)",

pages = "55--61",

booktitle = "Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016",

}

Liza, FF & Grzes, M 2016, An improved crowdsourcing based evaluation technique for word embedding methods. in Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), pp. 55-61, 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016, Berlin, Germany, 7/08/16.

An improved crowdsourcing based evaluation technique for word embedding methods. / Liza, Farhana Ferdousi; Grzes, Marek.

Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016. Association for Computational Linguistics (ACL), 2016. p. 55-61 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - An improved crowdsourcing based evaluation technique for word embedding methods

AU - Liza, Farhana Ferdousi

AU - Grzes, Marek

PY - 2016

Y1 - 2016

N2 - In this proposal track paper, we have presented a crowdsourcing-based word embedding evaluation technique that will be more reliable and linguistically justified. The method is designed for intrinsic evaluation and extends the approach proposed in (Schnabel et al., 2015). Our improved evaluation technique captures word relatedness based on the word context.

AB - In this proposal track paper, we have presented a crowdsourcing-based word embedding evaluation technique that will be more reliable and linguistically justified. The method is designed for intrinsic evaluation and extends the approach proposed in (Schnabel et al., 2015). Our improved evaluation technique captures word relatedness based on the word context.

UR - http://www.scopus.com/inward/record.url?scp=85093124836&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85093124836

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 55

EP - 61

BT - Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016

PB - Association for Computational Linguistics (ACL)

T2 - 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016

Y2 - 7 August 2016

ER -

Liza FF, Grzes M. An improved crowdsourcing based evaluation technique for word embedding methods. In Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP, RepEval 2016 at the 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016. Association for Computational Linguistics (ACL). 2016. p. 55-61. (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

An improved crowdsourcing based evaluation technique for word embedding methods

Abstract

Publication series

Conference

Other files and links

Cite this