# Tag Info

## Hot answers tagged alexnet

Accepted

### Why do we need 10 bits to represent the 1000 classes in AlexNet?

You need 10-bits ($2^{10} = 1024$) to represent 1000 classes.
• 1,503
Accepted

### Can the (sparse) categorical cross-entropy be greater than one?

Both the sparse categorical cross-entropy (SCE) and the categorical cross-entropy (CCE) can be greater than $1$. By the way, they are the same exact loss function: the only difference is really the ...
• 34.9k
1 vote
Accepted

### How is a neural network where the majority of inputs are 0 trained?

It's the loss function. I was using squared sum error, which I didn't think would have as a negative effect as it does, and I had to come to the explanation in my own time. Here's why: From the ...
• 1,266
1 vote

### Why do we need 10 bits to represent the 1000 classes in AlexNet?

It takes at least 10 bits to represent any number between $1-1000$ because $2^{10} = 1024$. This means that if one was trying to represent 1 of the 1000 classes, one would need at least 10 bits. ...
• 3,627

Only top scored, non community-wiki answers of a minimum length are eligible
{"ft_lang_label":"__label__en","ft_lang_prob":0.9555077,"math_prob":0.832203,"size":1056,"snap":"2022-40-2023-06","text_gpt3_token_len":274,"char_repetition_ratio":0.121673,"word_repetition_ratio":0.095744684,"special_character_ratio":0.28598484,"punctuation_ratio":0.11764706,"nsfw_num_words":0,"has_unicode_error":false,"math_prob_llama3":0.9869457,"pos_list":[0],"im_url_duplicate_count":[null],"WARC_HEADER":"{\"WARC-Type\":\"response\",\"WARC-Date\":\"2022-09-30T07:06:08Z\",\"WARC-Record-ID\":\"<urn:uuid:a0ce95f0-0608-43c5-b216-8414c727314f>\",\"Content-Length\":\"94543\",\"Content-Type\":\"application/http; msgtype=response\",\"WARC-Warcinfo-ID\":\"<urn:uuid:93b30711-9f91-4556-a791-3adcad854bd5>\",\"WARC-Concurrent-To\":\"<urn:uuid:f1c5941b-c4a1-4c44-bb10-8e05cadc9520>\",\"WARC-IP-Address\":\"151.101.193.69\",\"WARC-Target-URI\":\"https://ai.stackexchange.com/tags/alexnet/hot?filter=all\",\"WARC-Payload-Digest\":\"sha1:XHXPOWTD2N5YQRFCJY3TAM64XYXQMAA6\",\"WARC-Block-Digest\":\"sha1:E27VRWUK25Q2AY7TXIOG6BTWMM25NHEB\",\"WARC-Identified-Payload-Type\":\"text/html\",\"warc_filename\":\"/cc_download/warc_2022/CC-MAIN-2022-40/CC-MAIN-2022-40_segments_1664030335444.58_warc_CC-MAIN-20220930051717-20220930081717-00429.warc.gz\"}"}